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(54) Method and apparatus for processing text and character data 



(57) An apparatus and method for processing text 
or character data are disclosed. A text processing sys- 
tem receives a character input string and determines 
whether to apply character processing. A non-English 
language such as Italian can be entered into a process- 
ing system such as a computer using a standard Eng- 
feh based keyboard such that additional keys for 
providing accents or other grammatical and punctuation, 
symbols or characters not existing In English are not 
required. In one mode, text is automatically accented or 
punctuated without requiring user intervention. In 
another mode, a user is provided with a list of accent or 
punctuation choices so that the user may select the 

r 



optimum accent or punctuation. Text processing of an 
input may be activated by a predefined activator event 
pressed in a predetermined sequence, Dr may be acti- 
vated in the event a predetermined sequence of charac- 
ters is received. When an activator event input is 
detected, a rules based system Is utilized to select a 
correctly accented and punctuated character. A list of 
alternative accents and punctuations is optionally dis- 
played, and a user may toggle through the list using the 
activator event to select a desired character. The display 
provides information for a level of certainty of a selected 
character or word. 
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Description 

FIELD OF THE INVENTION 

5 [0001 J The present invention generally relates to the field of Information processing, and particularly to a character 
processing system. 

BACKGROUND OF THE INVENTION 

io [0002] The advent of computer technology has revolutionized the way in which people around the world communi- 
cate. One area in which computer technology has provided change Is in word and text processing applications. The first 
typewriters and computer terminals, which still set standards for text keyboard layouts, such as the "QWERTY" and 
"Dvorak* configurations, and for computer text encoding including the American Standard Code for Information Inter- 
change (ASCII) and the Extended Binary Coded Decimal Interchange Code (EBCDIC), were invented and widely used 

is In the United States, which continues to be the primary market for the introduction of such devices, and in which English 
is the official language. English is also both the most popular second language, as well as the second most popular 
mother language in the world. Written Engflsh uses the Roman alphabet with no diacritical marks (26 characters in 
upper and lower case: A B, C, D, E, F, G, H, l,J,KL, M, N, O, P,Q,R,S,T,U,V,W,X,Y and Z). Most other languages 
that use the Roman alphabet use an extended version of such alphabet, where diacritical marks such as accents and 

so umlauts, for example A A, A or A, are combined with certain alphabetical characters that are also used in English such 
as A. The characters that are present on keyboards designed for the English language are also present in most key- 
boards designed for other languages, whereas the additional non-English characters vary widely from keyboard design 
to keyboard design, depending on the target languages (e.g., German, French, Kalian, etc.). In a similarly limiting way, 
the first definitions of computer character sets, which specify how each character is to be stored in computer memory, 

25 did not assign codes to letters other than the 26 upper case and 26 lower case letters used In English. The most Impor- 
tant of these first character sets, which ere still rn use today, are ASCII, where 7 bits out of 8 are used to store informa- 
tion, and EBCDIC, which uses 8 bits of data, and is based on IBM's earlier BCD encoding. In the ASCII set, the upper 
range of 128 codes having the 8 th bit set was left undefined and unused. Similarly, in EBCDIC, certain blocks of codes 
were left unused. Over the years, both character sets have been extended in order to store certain non-English letters, 

30 either by replacing certain non-alphabetical characters with non-English alphabetical ones, or by assigning some 
codes, which had originally been left undefined. As newer character sets were defined, these in general maintained 
backward compatibility with either ASCII or EBCDIC. Even newer 1 6-bit and 32-bit global character encoding schemes 
(e.g., Unicode) retain, for compatibility, the original subset of 7-blt ASCII codes. This illustrates how, both for the layout 
of text input keyboards, as well as for character encoding definitions, there is a subset of characters which is in large 

35 part both privileged and standard. This subset includes the 26 letters from A to Z, in upper and in lower case (a total of 
52 alphabetical letters), the 10 digits, as well as certain spacing and punctuation signs, and other signs such as the 
apostrophe (ASCII decimal code 39), and the 'grave" character (ASCII decimal code 96), which is very similar to the 
apostrophe. Neither the original ASCII nor the original EBCDIC character encoding set provide support for letters used 
In non-English languages such as Italian. This means that on systems that employ these character sets there is no 

40 accepted standard for encoding, for example all the accented letters used in Italian, Thus there lies a need for a text 
processing system that allows the accents and punctuation of a non-English language to be processed by an English 
based system using standard English based input devices such as a QWERTY keyboard. 

SUMMARY OF THE INVENTION 

45 

[0003] The present invention Is directed to an apparatus for processing character or text Input. In one embodiment, 
the apparatus includes means for receiving an input, means for determining whether to execute character processing 
on the input, means for executing character processing on the input whereby an output is produced representative of 
the character processed input, and means for providing the output to an output system. 

so [0004] The present invention is further directed to a method for processing character or text input. In one embodi- 
ment the method Includes steps for receiving an Input, determining whether to process the input according to a prede- 
termined character processing rule, in the event it is determined to process the input, processing the input according to 
a predetermined character processing rule whereby and output representative of the processed input is produced, and 
providing the output to an output system. 

55 [0005] The present invention is directed in one embodiment to a character encoding and decoding method that 
allows accented letters to be stored using a standard unmodified character set, such as 7-blt ASCII. The encoding 
method of the present invention can be applied to a stream of data originating either from a file or from keyboard input 
events, as well as from other sources. The basic encoding method can be extended to detect and correct different types 
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of errors in the Input text, as well as to give total control to the user, to handle, for example, exceptions as well as delib- 
erate errors. 

[0006] A text encoding method whereby certain combinations of characters In a stream of text Input events are con- 
verted to other characters m the output stream, in consideration of the available Input device, the input and output char- 
5 acter sets, text context, language rules, character Input timing Information, and custom parameters. Several ways to 
interface with the host environment are considered. Custom parameters, both to configure the operation of the inven- 
tion, as well as to update the language rules and the database of character sets, can be entered by means of a dedi- 
cated interface, or by entering appropriate data into the input stream. 

[0007] The present Invention provides a method and apparatus for encoding diacritical marks, apostrophes and 

to other word-related signs, optionally correcting any errors that are found. The error management part of the Invention 
provides automatic error correction of accents, apostrophes and other signs used by the encoding techniques 
described here according to proper grammatical rutes. In one embodiment, the Invention may be utilized with languages 
wherein hints and activator event sequences provided in the input stream, e.g., by the user, are, alone, not sufficient to 
define a character In an unambiguous and error-free way. Accent encoding limitations are common both to keyboards 

is and to character set codes, and both can be treated as the source of a text input stream with the present Invention. The 
present Invention is also capable of being applied in one embodiment to overcome the limitations of both keyboard Input 
data, and text ffle data, as well as other, similar text streams. In an embodiment wherein the invention is utilized in real 
time, the present Invention eases typing of text in Italian and In languages with similar properties, making It possible to 
reduce the number of keys on a keyboard normally required for typing text In such languages, as well as allowing for a 

20 keyboard not specifically designed for such languages to be used, and virtually eliminating errors Involving diacritical 
marks, while providing for simple handling of exceptions. For Italian, an embodiment of the invention specifies different 
types of logic that can be applied to resolve specific ambiguities and errors typical of Italian writing. This Invention can 
also be very useful for German, Spanish, and other languages in which such logic is not necessary, for example, 
because hints and activator event sequences present in the text input stream are sufficient to unambiguously define a 

25 character, but, for reasons such as the lack of certain national characters In the keyboard or character set, a simpler 
way to Input national characters than the methods currently in use Is desirable. Additionally, the present invention pro- 
vides for different-ways to easily program and input characters that may not yet be encoded on a keyboard or character 
set, such as, for example, the symbol for the euro currency. 

[0008] In one embodiment, the present invention provides a simpler set of rules that can be Implemented in real 
30 time even on the slower systems. In alternative embodiment, a more complex set of rules may be implemented provid- 
ing more options for more powerful and professional systems. The present invention, in one embodiment, provides for 
the encoding, decoding and editing of text in Italian and similar languages using standard 7 bit ASCII character codes, 
thereby reducing text complexity and storage requirements compared to encoding methods which employ 8 or more 
bits of information per character. The present method provides for the automatic correction and processing of text 
35 streams employing 7. 8 or more bits of significant character information by automatically recognizing factors such as 
the character encoding set and the language of the text, and appropriately applying the encoding method. The method 
is capable of normalizing text to a standard format so that It can more effectively be indexed or used for comparisons 
and searches in applications such as Internet search engines, or the search functions In word processing and database 
applications. 

40 [0009] It Is to be understood that both the foregoing general description and the following detailed description are 
exemplary and explanatory only and are not restrictive ol the Invention as claimed. 

[0010] The accompanying drawings, whteh are Incorporated in and constitute a part of the specification, illustrate 
an embodiment of the invention and together with the general description, serve to explain the principles of the inven- 
tion. 

45 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] The numerous objects and advantages of the present Invention may be better understood by those skirled 
in the art by reference to the accompanying figures in which: 

50 

FIG. 1 is a block diagram of an overall system level embodiment of the present invention; 
FIG. 2 is a block diagram of a computer system capable of tangibly embodying the present invention; 
FIG. 3 is a flow diagram of a method for processing text input in accordance with the present invention; 
FIG. 4 is a flow diagram of a method for processing text in accordance with the present invention; 
55 FIG. 5 is a flow diagram of a method for processing text in accordance with the present invention; and 
FIG. 6 is a flow diagram of a method for processing text In accordance with the present Invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

[00121 Reference will now be made in detail to one or more embodiments of the invention, examples of which is 
Illustrated In the accompanying drawings. 

5 [001 3J Referring now to FIG. 1 , a block diagram of an overall system embodiment of the present Invention wilt be 
discussed. System 1 00 includes a text input system 11 0 that includes at teast one or more of several means by which 
text or character data may be provided as input to processing system 126, Text input system 110 may comprise, lor 
example, a keyboard 1 12 with which a user is able to manually enter or type text or characters to provide a text or char- 
acter input stream, or a file 1 14 In which text or characters are stored in a format that is capable of being read, inter- 

w preted and processed by processing system 126. Furthermore, tnput system 110 may include a microphone 116 
coupled to a speech-to-text engine 1 18 such that words or utterances spoken by a user are processed Into a text or 
character stream that Is capable of being Interpreted and processed by processing system 1 26. Additionally, Input sys- 
tem 1 1 0 may include a graphical image file 1 20 generated by optically scanning a text document that is then processed 
by an optical character reader that is capable of producing text or characters that are capable of being interpreted and 

is processed by processing system 126. 

[0014] Processing system 1 26 may be any type of system that is capable of processing and editing text or character 
input In one embodiment, for example, processing system 126 includes an operating system 130 for controlling an 
application 1 30 that is capable of processing and editing a text or character stream provided to processing system 1 26. 
For example application 1 30 may be a standard word processor such as MICROSOFT WORD for running under oper- 

20 ating system 1 28 that may be, for example, MICROSOFT WINDOWS 98, MICROSOFT WINDOWS NT, MICROSOFT 
WINDOWS ME, or MICROSOFT WINDOWS 2000, all of which being available from Microsoft Corporation of Red- 
mond, Washington. As text or character data is processed by application 1 30, operating system 126 Is capable of caus- 
ing the resulting output of application 130 to be provided to output system 132. Output system 132 may Include, for 
example, display 134 for displaying the output of application 130 in a format readable by a viewer, file 136 for storing 

25 the output of application 136 for later retrieval by operating system 126, or a storage database 138 wherein the output 
is stored in a format readable by other applications or by other computer systems. 

[0015] In operation of the present invention, a text Interpreter 124 receives an incoming text or character stream 
provided by input system 110 and processes the text or character stream In accordance with predetermined text 
processing rules. Text interpreter 124 may be tangibly embodied, for example, as a stand-alone hardware or firmware 
so device connected between input system 110 and processing system 124. Alternatively, text interpreter 124 may be 
directly Incorporated into one or mo re Input devices 1 1 2-1 22 as hardware, firmware, software, o r a combination thereof. 
In a further alternative embodiment, text Interpreter 124 may be Incorporated in processing system 126 as a hardware 
device, as firmware, as software or as a combination thereof. For example, text Interpreter 124 may be Included as a 
portion orsubroutine of operating system 128 or application 130. Alternatively, text interpreter 124 may itself be a stand- 
35 alone application that is capable of providing an output directly to output system 132 or that is capable of being read 
and interpreted by application 130. In a further alternative embodiment, text interpreter 124 is capable of operating 
simultaneously and in conjunction with application 1 30. Thus, one having skill In the art would appreciate that the place- 
ment of text Interpreter between text Input system 1 10 and processing system 126 Is for example purposes and need 
not be limited to the position illustrated in FIG. 1 . As alternative embodiments, text interpreter 1 24 may be incorporated 
ao within text Input system 1 1 0, for example being built into keyboard 1 12, or may be incorporated into processing system 
126, for example as part of either operating system 128, application 130, or as a self contained hardware device, 
firmware, or routine or process running on processing system 1 26. 

[0016] Referring now to FIG, 2, a block diagram of a computer system that is capable of tangibly embodying the 
present invention will be discussed. Computer system 200 is capable of implementing, at least in part or in whole, text 

45 processing system 100, or any portion thereof, as discussed with respect to FIG. 1 . Computer system 200 includes a 
processor 200 for processing digital data. Processor 200 may comprise, for example, a complex Instruction set comput- 
ing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long Instruction word 
(VLIW) microprocessor, a digital signal processor (DSP) , a combination of processors, or the like. A bus 224 couples to 
processor 210 for transmitting signals between processor 210 and other components, systems, or devices of computer 

so system 200. A read-only memory (ROM) 212 is coupled to bus 224 for storing information that is intended not to be 
rewritten, or only rewritten infrequently. A random access memory (RAM) 21 6 couples to bus for storing information that 
can be dynamically written or read by processor 210. ROM 212 includes a basic input-output system (BIOS) routines 
for Initializing computer system 200 and loading operating system (OS) 21 8 Into RAM 21 6 at startup, and for facilitating 
the transfer of information among the devices of computer system 200. Operating system 218 may be loaded from a 

55 hard disk drive 232 coupled bus 224 via hard disk drive controller 230 in which case operating system 234 is the same 
as operating system 218. Likewise, RAM 220 may store one or more programs 220 and one or more files 222 that may 
be loaded from hard disk drive 232 in which case program 236 and file 238 are the same as program 220 and file 222, 
respectively. A display adapter 226 couples to bus 224 for displaying a video signal received via bus 224 on display 228. 
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Computer system 200 may Include one or more removable storage medium device controllers 240 for controlling one 
or more removable storage medium drives 242 that is capable of reading from or reading from and writing to a remov- 
able storage medium 224 on which a program 246 or a file 248 may be stored. For example, removable medium may 
Include, but is not limited to, a compact disk read-only memory (CD-ROM) or a writable CO-ROM, a floppy disk, an opti- 
cal disk, an optical-floppy disk, a digital versatile disk (DVD or DvT> ROM) or a writable DVD, laser disk, magnetic tape 
(e.g., reel or cassette), removable hard disk drive, semiconductor memory (e.g., flash memory card or memory stfck), 
or the like. An Input/output (I/O) controller 250 is coupled to bus for connecting computer system 200 to one or more 
input, output, or input/output devices such as modem 252, \tO device 254, mouse or graphical user interface (GUI) 
device 256, keyboard/keypad 258 or the like. I/O controller 250 may provide one or more ports euch as a serial port, 
parallel port. Universal Serial Bus (USB) port, or the like. I/O device 254 may include any one or more I/O device such 
as a touch screen input device laid over display 228 for operating as a GUI device in conjunction with a GUI based oper- 
ating system. Real-time clock 260 provides one or more timing signals for synchronizing the operation of the devices of 
computer system 200. A network adapter 262 is capable of coupling computer system 200 to a remote system 266 via 
network 264 such as a local area network (LAN) or intranet Likewise, modem 252 is capable of coupling computer sys- 
tem 200 to a remote system 268 via a remote network such as a wide area network 268 or e world-wide network such 
as the Internet Remote system 266 may be coupled to a storage medium 270 on which a program 272 or file 274 is 
stored that may be transferred from remote system 266 via network 264 or remote network 268 to computer system 200 
and stored, for example in RAM 21 6, hard disk drive 232 or removable medium 244. In one embodiment, computer sys- 
tem 200 and remote system 266 may implement a client-server arrangement in which the processing of an application 
may be divided between one of computer system 200 or remote system 266 and the other. Computer system 200 may 
be a dient and remote system 266 may be a server, or vice-versa. Text interpreter 124 of FIG- 1 may be implemented 
with computer system 200 as a program of Instructions executable by processor 21 0, or may be Implemented as an I/O 
device 254 coupled Wine with another input device (e.g., keyboard/keypad 258) or operating In parallel therewith. 
[0017] In one embodiment of the present invention, text system 1 00 is capable of processing an incoming text string 
25 according to the rules of the Italian language using a standard Input device or system such as a standard, English 
based keyboard. Although the present invention Is particularly directed to the Italian language for example and discus- 
sion purposes, one having skill in the art would appreciate that the teachings of the present invention may be applied 
to many other languages, Including but not limited to French and Germanic languages. It Is not intended that the present 
invention be limited to Italian or any other specific language. . 
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Functions of The Invention 



[0018] In accordance with the present Invention, system 1 00 Is capable of processing a stream of file of text data. 
The data can for example be keyboard data as it is typed (connecting to the operating system as a keyboard hook, or 
35 through interfaces for input method editors, or through interfaces for assistive technologies, or physically connecting to 
the keyboard hardware, etc.), or data being read from an existing file, or data being accessed through a standard inter- 
face provided by programs like MICROSOFT WO RD, or computer clipboard data (which the user has copied there, sys- 
tem 100 processes, and Is then ready for being pasted back). A hook is defined in at least one embodiment of the 
Invention as a location in a routine or program in which the programmer can connect or insert other routines for the pur- 
40 pose of enhancing functionality. A keyboard hook Is defined as a hook routine or program that implements the connec- 
tion or insertion of routines using keyboard Input. System 100 has access to all input data, and It can also affect the 
output data to apply certain changes, which are the objective of this invention. How this is accomplished is a function of 
the implementation. For example, if system 100 is implemented in the same program that writes the data, for example 
a file processor or a word processor, then system 1 00 can dlrectiy write the processed output data, modified as neces- 
sary. If however system 100 is implemented as a keyboard hook, especially in an interactive context where the user 
expects to immediately see every character typed, either in software by Inserting itself in the operating system's or the 
application's input stream, or as hardware, e.g. as a device plugged between keyboard and computer, then it may 
change .the output data by simulating the input of appropriate backspace or cursor movement characters, followed by 
new output data, to change data that already resulted in screen display. Even when system 1 00 is passive, i.e., it does 
nothing to actually modify the text, it is busy collecting context information, i.e., H maintains a local buffer of all recent 
input. This Is necessary to know the full word that Is currently being written, and also optionally to understand the con- 
text in which the last word or character appears, for example to identify an apostrophe character that can be expected 
to be part of a closing quote because system 1 00 has previously recognized an opening quote, so that It is not confused 
with an apostrophe that may have some other meaning that would affect the operation o1 this system. If system 100 is 
implemented in a way that it has direct access to text context information, for example as part of a word processor, or 
through an interface to a word processor that gives such access, e.g., MICROSOFT WORD scripting Interface, or as a 
file processor that only deals with a continuous input stream, then context information can also be acquired directly on 
the text data itself, without needing to keep a copy of the recent data in a local buffer. There are however cases in which 
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the text input stream is not linear, or It can be disrupted, for example when system 100 Is Implemented as a keyboard 
hook, and the user moves the Cursor Up or Sown keys, or the mouse, to reposition the cursor. These cases can be 
detected (by detecting keyboard, mouse and other input events that atfect the position of the text Input position), but it 
Is not always possible to reconstruct the new local context information (e.g., system 1 00 does not know where the cur- 

5 sor is, after a Cursor Up). In some cases the new context can be reconstructed by on-screen character recognrtfoa 
[0019] System 100 Is character-oriented, i.e., It becomes active when certain characters are encountered In the 
input stream. Implemented in a keyboard input context, ft reacts to certain keyboard keys. No special conversion keys 
are necessary. Rather, system 100 uses context Information to give special meaning to an otherwise posstoly standard 
(because it may also appear in the text) input character. In the algorithms of this system, context Information is com- 

w blned with the most recent input character, and also, optionally, In a dynamic way to the number of times the last Input 
character occurs In a row, resulting, In the case of keyboard Input, in a dynamic sequence. 

(0020] System 1 00 described herein provides the ability to affect not only the current character, but also previous 
characters. System 100 described here implements •smart" procedures to process the combined context and input 
data, and generate output data In a way that results in new, reliable, intuitive and extremely useful text input methods 

15 which have practical applications in Italian, German, French and other languages which use Latin characters plus dia- 
critical marks (but also to generate some special non-Latin characters). The present system is on one embodiment 
focused on the input of certain characters while the single characters are being written, and in particular Italian 
accented vowels, but also characters with diacritical marks in other languages, and also certain non-word characters 
(currency symbols, etc.). Only in certain cases does system 100 take action at the end of a word to re-correct or further 

20 modify a previous mid-word correction. This may happen for example when system 100 detects that an apostrophe 
originally Interpreted to indicate an Italian accent was Instead meant to be an English possessive which can only be rec- 
ognized after a non-word character follows an V which follows an apostrophe. In general, system 100 Intervenes in real 
time on each character. The definition of a word herein encompasses any word, punctuated or unpunctuated, accented 
or unaccented, contracted or uncontracted, with or without liaison, or any letter, portion, character, or subcombination 

25 thereof. 

[0021] In one embodiment of the invention adapted to the Italian language, when writing or otherwise inputting text 
to any application, an activator event Is used, which for the case of Italian the apostrophe character. During character 
Input, a correct or optimal accenting of a word Is provided upon a first encounter or entry of the apostrophe character, 
for example when the apostrophe key Is actuated during typing. If an alternative accented word form is desired, for 

30 example while inputting a French won* during writing of Italian text, an additional encounter or actuation of the apostro- 
phe character will select an alternatively accented word. The apostrophe character may further be utilized in various 
ways to override automatic actions provided by system 100, and with automatic detection and re^orrection or further 
modification of * *s ' possessive word forms in English. The software of system 100 works in one embodiment by func- 
tioning as an add-on on the keyboard input stream, but can also be directly embedded in text editing software, in the 

35 operating system, and on text systems of hand held devices, for example. It should be noted that an activator event may 
be Indicated by one or more events or one or more sequences or combination of characters, input events, keyboard 
actuations, etc., so that the term activator event may be defined as encompassing these several events and sequences. 
For example, an activator event Is defined In one embodiment as any key or character on a standard keyboard or in a 
standard character set (e.g., 7-bit ASCII). In one particular embodiment of the Invention, the apostrophe character, or 

40 the apostrophe key, Is defined as an activator event. Upon an activator event, such as the actuation of the apostrophe 
key or the input of an apostrophe character will cause system 100 to detect an activator event and provide an appropri- 
ate response, e.g., modification of a word immediately preceding the activator event, initiation of an IME loop as 
described herein, etc. In another embodiment, an activator event is defined as an activator event that is preceded by 
another character that, when appearing or occurring in combination, result In system 100 detecting an activator event. 

45 For example, an apostrophe character preceded by any vowel character is detected by system 1 00 as an activator event 
or an activator event so that system 100 provides an appropriate word modification or other response. In another 
embodiment, an activator event is defined as two characters appearing or Input in succession, for example two vowels 
appearing in succession result in system 100 detecting an activator event so that an appropriate modification of the 
word or other response is provided. In one particular embodiment, an activator event or at least one character of an acti- 

so vator event is keyed or otherwise input in succession wherein each successive actuation or input of the activator event 
causes system 100 to Initiate an additional appropriate response. For example, a vowel followed by a single apostrophe 
character or event causes system 100 to modify the word so that a first accented form of the vowel is provided, e.g., 
using a grave accent. An additional input or actuation of an apostrophe causes system 100 to provide a second 
accented form of the vowel, e.g., using an acute accent. A yet additional input or actuation of an apostrophe causes 

55 system 100 to provide a third accented form of the vowel, e.g., using a circumflex accent, and so on. System 100 may 
continue to provide additional accented forms until an entire list of accented forms is provided. At the end of the list, in 
one embodiment, system 100 again provides the first accented form of the word or vowel so that the list is effectively 
circular, or closed, and optionally including an unmodified form of the word or vowel, with or without the ending apos- 
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trophe activator event In an alternative embodiment, the list Is open so that at the end of the list, system 100 provides 
the original, unmodified form of the word or vowel, with or without the ending apostrophe activator event and system 
1 00 does not go through the list an additional time. In an alternative embodiment, system 100 detects an actuator event 
when an activator event or input event lasts for a predetermln ed duration of time, in combination with another character, 

5 or alternatively independently of other characters. For example, when an apostrophe character is input, but is actuated 
or keyed tor a duration less than the predetermined duration of time, system 1 00 does not detect an activator event, and 
no modification of the word or other additional processing Is provided. On the other hand, when an apostrophe charac- 
ter is actuated for a time at least equal to or greater than the predetermined period of time, system 1 00 detects an acti- 
vator event and provides an appropriate modification or other response. In a particular embodiment of the Invention, 

io when an activator event is input for additional periods of the predetermined duration of time, each additional period 
causes system 100 to detect an additional activator event and to provide an additional modification or other response 
in a manner similar to that of where an activator event is activated and detected several times in succession as dis- 
cussed, above. For example, if a currency character is defined as an activator event, then when a user holds down a 
representative currency character key for a duration of time, after a first period a first currency symbof is provide, after 

75 a second period a second currency symbol Is provided, and so on, in either a closed or an open loop, until a desired 
currency character is provided at which time the user may release actuation of the activator event so that the currently 
provided currency symbol Is maintained. Thus, an activator event may be defined to encompass a key actuation, singly 
or in a combination, a key actuation maintained (e.g., pressed) for a predetermined duration, a character in an input 
stream or text file, singfy or in combination with other characters, and so on. An activator event therefore encompasses 

20 any one or more of the following events, alone or in combination: the same key pressed twice, the same character 
encountered twice, a predetermined key, a predetermined character, a predetermined key or character preceded by at 
least one or more other predetermined keys or characters, or alternatively succeeding the predetermined key or char- 
acter, a predetermined key held down or otherwise actuated or maintained for a predetermined duration, optionally 
being preceded by another predetermined key or character, an accented key or character, a vowel key or character, an 

25 accented vowel or character, and so on. Thus an activator event encompasses input data and input events. Any one or 
more of activator events combinations as described herein, or variations and combinations thereof, or in addition to 
those described herein, may be recognized and detected by system 100 without providing substantial change to the 
present Invention. Any one or more of the activator events or combinations as described herein may be optionally 
applied to any one or more of the embodiments or language implementations of the invention described herein oreim- 

30 ilar to those described herein without providing substantial change thereto. 

[0022] Using different variants and combinations, the two aspects of the invention are: Using a key or character, an 
activator event, as part of an interactive, dynamic "input method editor* system, to handle accents in foreign words, and 
to otherwise write any combination of accents and special characters as desired. Each time an activator event is actu- 
ated in relation to a specific vowel or other context, system 1 00 generates a new character or character combination, in 

35 a loop. The order or hierarchy in which the characters are generated can be constant, context-based, or custom, or 
experience-based that depends upon previous selections. The activator event or key in one embodiment is occurrence 
of an apostrophe after a vowel in the Italian language, or alternatively an V after V, V or V or V after's" in German. 
The activator event that is used can be a function of the language for which system 100 Is utilized according to letter 
and accent combinations that appear in the particular language applied 

ao [0023J The present Invention automatically places the correct Italian apostrophe or accent on a vowel, based upon 
encounter or actuation of an activator event In particular, when the apostrophe is used as the activator event, there may 
be existent cases where context based process is utilized to determine whether an occurrence of an apostrophe is 
word-related or not, that is Intended for another purpose, for example as an opening or closing single quotation mark. 
In the event it Is determined that an occurrence of an activator event is word-related, the English *V possessive is rec- 

45 ognized and accounted for where appropriate. Also, with certain types of actions using an activator event where an 
apostrophe Is entered as a recognized mistake, system 100 is capable of deleting the entry, or deleting the entry and 
replacing it with a space character, depending on Italian writing rules, for example, where the apostrophe can be used 
as part of a word, or between words rather than as an accent. 

so Discussion of The Italian Language 

[O024J Compared to other languages, the relationship between Italian writing and pronunciation is quite easily 
specified by rules that provide relatively intuitive spelling and easy pronunciation of new words. One exception where 
most errors occur is related to the proper placing of accent and apostrophe signs in written text. Most Italian words end 
55 with a vowel. The pronunciation of Italian is such that the primary stress usually falls on the penultimate vowel, the sec- 
ond vowel counting from the end of the word, i.e., the syllable before the last one. Accents are used to indicate an 
exception to this rule. In Italian dictionaries and in some cases also to avoid ambiguities between words that have dif- 
ferent meanings but differ only by the primary stress (e.g., turbine and turbine), accents are used on vowels inside a 
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word, In general writing, however, accents are used only on vowels at the end of a word, and indicate that the primary 
stress Is on the last syllable (e.g., pert). On some words (e.g., qui) the primary stress falls on the ending vowel, but no 
accent sign Is used, a frequent cause of errors when writing as there is no specific rule; one must learn all the excep- 
tions. Italian words are sometimes truncated (also referred to as elision), and In this case an apostrophe is used at the 

5 end of the word to Indicate that a part of the word Is "missing". If the last character of the truncated word Is a vowel, the 
primary stress usually defaults to that syllable, which Is marked by an apostrophe after It (not by an accent). In consid- 
eration of the evolution of language, writing rules change over time to accept truncated words as new words, which usu- 
ally means that they are not written with an apostrophe any more, but rather with an accent, or with no sign at afl. In 
practice, truncated words are sometimes so common that writers are not sure If the word is stUl considered truncated 

to or not, leaving a doubt on whether an apostrophe should be used, or an accent, or no stgn at all. For example, the Italian 
word poco is frequency truncated to po\ It is a common mlstaka to write It as pd. Another word, piede, has a truncated 
form, originally written as pie ', now commonly accepted as pie In spHe of the fact that It less frequent than po '. Similar 
ambiguities also affect truncated words which are written without any sign on or after the last character, such as quale, 
which becomes quat, and frate, which becomes fra, whereas it Is a common mistake to write qua!' or tra \ In some 

y5 cases an apostrophe is used if the following word is of leminine gender but not If the word Is masculine (e.g., una attra 
becomes un 'aft/a, but uno attro becomes un aJtro). On certain other words, for example weekdays ending in T such 
as tuned), It b a common mistake to omit the final accent. 

10025] A peculiarity of the writing of truncated words ending with an apostrophe Is that If the last character of the 
truncated word is a consonant, then the apostrophe also acts as a spacing character between that word and the follow- 
20 Ing one, I.e., no space character Is used between the two words. A text processing system In accordance with the 
present invention removes an incorrect apostrophe sign takes this into consideration In order to place an appropriate 
space character where necessary. 

[0026] Different diacritical signs are used for writing In Italian. In addition to the apostrophe, the grave accent (as in 
E) and the acute accent (as In i) are used in everyday writing. The Italian National Standards Body (UNI) standard, 

25 UNI 6015-67 "Compulsory Stress Mark In The Italian Language Orthography", first published by the Italian National 
Standards Body In 1967, sets the rules by which grave and acute accents have to be placed on vowels in certain words. 
The circumflex accent (as in I) is also sometimes used, but like the use of grave and acute accents In the middle of a 
word It Is generally associated to a more sophisticated and In part old-fashioned writing style, whereas in modem Italian 
the trend is to let certain ambiguities be resolved by the context in which the word appears, and not using grave and 

30 acute accents inside words (but only at the end), or circumflex accents. The norma! Italian writer is not expected to use 
such a style other than in exceptional cases, which could Include the writing of French or Spanish words in an Italian 
context, but the invention described herein allows for Input and processing of such custom characters as well. 
[0027] Typically, even a skilled but non-professional writer of Italian does not know when to put a grave accent and 
when instead to put the acute accent. In general, this is not taught at Italian schools; Instead a single sign having the 

35 appearance of a small opening parenthesis rotated by 90 degrees counterclockwise (similar to the "breve" character 
used in decimal positions 728 and 774 of the Unicode character set, i.e. is used as a 'simplified fit-all accent sign*. 
This sign, used exclusively in handwriting, is not defined by UNI 601 5-67, and does not exist in printed text or on Italian 
keyboard layouts. 

[0028] The use of proper acute and grave accents is in general always found in print, but is in general only learned 

40 as part of specific editorial, journalistic and printing training and studies. The fact that the Italian school system focuses 
on handwriting but not printing, and that personal computers are increasingly giving non-professional writers the ability 
to put words In print, results in an increasing degradation of the quality of printed words, which this invention aims to 
solve. The use of the apostrophe at the end of words, which historically indicates a truncation of an originally longer 
word, Is in general taught at school, but remains a common source of mistakes in writing. Like an accent, an apostrophe 

45 at the end of the word adds emphasis to the last vowel of the word. This same emphasis Is clearly reflected in the stand- 
ard spoken language. This means that, on average, an Italian knows well when a word ends "either with a grave accent 
or with an acute accent or with an apostrophe", because this is how the word is spoken, but when writing the choice 
does not come intuitive. Certain words have a phonetic emphasis on the terminal vowel, but no graphical sign (accent 
or apostrophe) in the printed word (as in me and qui). This exception, whereby the printed form does not reflect the pho- 

50 netic stress, is another frequent source of mistakes, so that accents and apostrophe signs are sometimes placed where 
they should not. Like all languages, Italian is in constant evolution. This means that there are cases and contexts, usu- 
ally determined by editorial policies, in which certain words are written in a different way than for example the UNI spec- 
ification indicates. An example of this is the word pie, which some prefer to write as pie 1 (as if it were a short form of 
piede, which historically it is). Other choices involve the use of accents, whereby for example some newspapers prefer 

55 to use acute accents in some cases where the UNI rules would require a grave accent, or vice versa. Another frequent 
source of diversity is the use of accents on capital letters. Some editorial styles prefer (often due to technical limitations) 
not to put accents on all-capital words, putting instead an apostrophe at the end of the word Instead of a final accent, 
and simply remove accents m the middle of capital words, as is sometimes done in French. MICROSOFT WORD 97 
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includes an option to allow for accented uppercase in French, but no specific options for Italian. In these cases, where 
official rules lack, or where these are different than editorial choices, the most important rule becomes consistency, i.e., 
not to use one time one style and another time a different style in the same context The Invention described herein can 
be applied and programmed to enforce consistency In consideration of different preferences. 

5 [0029] Ever since the Introduction of typewriters, it has been a common convention in Kalian to use the apostrophe 
sign after a vowel in those cases in which the proper accented vowel is not available on the keyboard or in the character 
set being used. Considering the needs of a very simple style of Italian writing (e.g., for personal correspondence), at 
least 7 accented characters are needed (a, e, e, £, /, b and u). Anybody using all-capital words or sentences (e.g., in 
titles) will also need to use additional 5 capital accented letters (A t £, /, O and U), bringing the total to 12. More 

w demanding writers and contexts need additional 4 characters (f, f, 6 and 6), for a total of 16 accented characters. 
[0030] The main other contexts in which apostrophe characters are used in Italian writing Is as quote characters (to 
delimit a text, before and after it, as In text), and after numbers (e.g., 5"2). In these cases, the apostrophe character 
is sometimes used twice instead of a double quote character, which Is in general more preferable (e.g., "text" instead 
of *texT). An automate text processing system must be able to recognize these cases, not only for example to convert 

15 the quotes into the proper opening and closing characters (e.g., MICROSOFT WORD, which converts texf to torf'and 
9 texf to Vexf ), but also, in the partlcufar case of Italian writing, to determine the likely Intention of an apostrophe char- 
acter when there Is ambiguity (in very rare cases a word may exist both with and without apostrophe or accent) or insuf- 
ficient data (e.g., no matching entry In the dictionary of the software). In system 100 described herein, which can be 
applied so that pressing the apostrophe key once places the correct apostrophe or accent on a word (e.g., perche' 

20 becomes perch6\ and pressing ft again produces different variations (e.g., perche, percM, perche, perche\ perch6\ 
etc.), the recognition of a context where an ending quote has to be expected (because an opening single quote 
appeared within a certain range before the current position, as in 'perch) allows system 100 to automatically interpret 
the first input of the quote character as an acute accent (perche^), and the second input of the same character as the 
ctosing quote ('perche'), instead of an attempt to write 'perche (forcing an incorrect accent to be written). Similarly, If a 

25 word for which system 100 cannot apply any Italian rules (e.g., a completely unknown word which is not even recog- 
nized as a likery foreign word) Is typed in a context where a single ending quote is to be expected, system 100 may be 
programmed to propose as a first output character a closing quote, rather than an accent (e.g., 'dedededo abababo' 
Instead of 'dedededo abababo). 

[0031] Apostrophes may also appear in Italian writing as part of a change of language context, which could be for 
30 a single word, or for longer parts of text. System 100 described here can be programmed to recognize apostrophes 
used In other languages, e.g., in German and English genitives and abbreviations (as In Eva '$ Apfet and e/pW o 'clock), 
which have no match in Italian. While the fact that German Is an official language in Italy and English is the most fre- 
quently-used second language is one consideration, such a set of rules can improve the overafl reliability of system 1 00 
so that it produces little or no incorrect output even when processing (trying to apply Italian accent rules) long non-ftal- 
35 ian texts of any language based on Latin-writing. 

Variations of the apostrophe character 

[0032] Some computer keyboards reflect the fact that the 7-bit ASCII character set contains both an "acute apos- 
40 trophe" and a "grave apostrophe* character (decimal codes 39 and 96, respectively), and, accordingly, have keys to 
Input both characters. This is a common cause of inconsistencies when writing, since it is desirable that in a text only 
one type of character be used to represent the apostrophe (but not for opening and closing single quotes, where, 
depending on the font being used, the two characters are appropriate to differentiate between opening and closing sin- 
gle quotes). System 100 described herein can be programmed to convert, for example, the apostrophe character 
45 entered with the grave key to the "acute apostrophe" character, leaving the character unchanged if it is used as a single 
quote character. Some keyboards and character sets have an even wider range of characters and keys that can be 
used, deliberately or by mistake, for' the same purpose. 

Discussion of Other Languages 

50 

[0033] Other languages have in part needs similar to Italian, but cannot always be algorfthmically solved with the 
same accuracy. German for example has upper and lower case versions of "a", "d" and "0", which are written as "ae", 
"oe" and "ue" when these characters are not available. The special character M W (lower case only) is expanded to *ss" 
when not available as well as always in upper case ("SS"). Different techniques have been proposed to automatically 
55 process German text files to add or restore the missing Umlaut characters, but none with the reliability that system 100 
described here achieves for ItaRan and Its special characters. The interactive mode of the present invention, where the 
user could for example enter "o" and then repeatedly press the "e" key to toggle from "6" to "oe*, could be of great help 
to combine automatic procedures with manual corrections during typing. 



9 



EP 1 093 058 A1 



[0034} In Spanish vowels may have an acute accent, and the apostrophe character Is only used for quotes (It is not 
part of words, as In Italian). This would make It possible to use the apostrophe key after a vowel to enter the vowel with 
an acute accent A similar sequence could also be used for other Spanish characters that are variations of characters 
without diacritical signs, such as -ft". Apostrophe characters that are part of quotes, or English possesses, could be 
5 recognized by the more generic procedures that are part of this system. Writing a vowel followed by an action indicating 
an accent Is more Intuitive for the writer (as It is more similar to handwriting) than system 1 00 currently employed on 
Spanish personal computers, which requires that the user first enters a "dead key" Indicating the desired accent, and 
then the vowel. 

(0035] French employs an even greater variety of characters, as it uses acute, grave, circumflex and dieresis signs 
10 on top of vowels, plus some other characters, like V- Because of this variety, which requires a lot of keys on a keyboard, 
the interactive use of this system could be of great advantage on a system with a reduced number of keys, also possibly 
in combination with some language-oriented algorithms (as for the other languages discussed here). 

Other Applications 

15 

[0036] The above examples for Italian, German, Spanish and French illustrate how a certain text context followed 
by a certain input results in a certain algorfthmically-modifled output, so that system 100 can be optionally be modified 
In a dynamic 1ashlon, and controlled by the user. In an application of system 1 00 where repeated input of a certain key 
is provided, for example the dollar key, produces different, alternating currency symbols, (e.g. euro, yen, pound, etc.) 

20 can be Implemented as a subset of system 1 00 descrfced herein. In one embodiment, system 100 Intercepts repeated 
inputs of certain keys, and sends -fake" backspace characters In the Input stream, followed by new characters, to pro- 
vide the desired character combination output For example, system 1 00 may be utilized in Deu of or in conjunction with 
a euro key, wherein the position of the euro key on computer keyboards is as of yet undetermined, and is likely to 
change in the future, wherein a special euro key Is provided. System 100 in accordance with the present invention is 

ss capable of Implementing a universal currency key. 

Non-Linguistic Factors 

[0037] Utilization of Italian letters with diacritical signs exceeds the limits of the character sets and keyboards orig- 
so inally designed for English. The original ASCII and EBCDIC character sets, still in use today, support none of these 
characters. The present invention provides automatic conversion both from an accented Italian which requires support 
by a character set newer than ASCII, to an Italian using standard ASCII character set, and to restore the accented Ital- 
ian characters based on a 7-bit character set such as ASCII. The present Invention effectively eliminates accent-related 
inconveniences caused by the use of 7-bit bottlenecks that are still common in the computing world, especially in con- 
as slderation of the Increasing interconnection of different systems. 

Text Normalization 

[0038] When a user of an Internet search engine or dictionary lookup software enters a word or sentence, the 
40 search key and the entries being searched should match. However, considering that for example calamity, catamite 
and caiamlta ' are three different ways in which, in practice, the same word may be written, while the word calamita (with 
no sign) is a different word with a different meaning, an advantage is provided where both the search key and the text 
being searched are normalized to a common format, using system 100 in accordance with the present Invention. Word 
format normalization ts provided using the same or similar rules that are applied in real time where text is being typed, 
45 for example. The invention described herein normaPzes text using the correct accent and apostrophe characters, or 
using only apostrophe keys (i.e. only 7-bit ASCII text), and, whatever the desired format, is capable of converting Italian 
text from one format to the other, without toss of Information, and while maintaining a natural text readability, I.e., without 
Introducing control codes which are perceived by the human reader as "artificial" or unreadable. 

so Integration wrth Other Systems 

[0039] Operating system support for input methods provides processing of user input regardless of the target appli- 
cation. In one particular embodiment of the invention, one or more application-independent layers are provided by some 
operating systems, for example MICROSOFT WINDOWS, as well as by some applications, for example MICROSOFT 
55 WORD. An application-independent layer may consist, for example, of a set of functions dedicated to error detection 
and correction. System 1 00 described herein is capable of Integrating with such a set of error management functions. 
System 100 can also be directly integrated at the application level, for example in a word processor. In this case, text 
context information, as well as input data, is directly accessible to the method employed by the invention, which can also 
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directly produce output in the format used by the application itself. 

[0040] When Integration at the operating system level is not possible, and Integration within the application Is either 
difficult or Insufficient, techniques may be used to obtain text context information, and to Intercept user Input, and to then 
forward such processed Input to the operating system or to an application in real time. For example, tBXt context Intor- 

5 matlon Is acquired by system 100 by monitoring the keyboard and display activity. Such context Information may be 
used to apply different rules based on both the text context and the user Input The resulting output is then forwarded 
either to the operating system, or to the keyboard control system, acting as if the user typed the data, or it is sent directly 
to the application. On architectures where It is possible to only detect, but not to remove the original input stream, the 
text processing method may insert appropriate tursor - , ^jackso^e" and 'delete" characters, in addition to new text 

w characters, to the Input stream in order to force applications to replace a series of Input events with a new series of proc- 
essed events generated by the text processing function. 

[0041] Several other cases of possible and useful integration of this invention are known. In a particular embodi- 
ment, text search procedures, as used within word processing and database applications, as well as on the Internet uti- 
lize system 1 00 both with the search string or with the text being scanned so that both are expressed in a standard and 

75 correct form, and so more efficient results are produced. 

[0042] Referring nowto FIG. 3, a flow diagram of a method for processing text In accordance with the present inven- 
tion will be discussed. Method 300 provides a first step 310 for receiving character input. As characters are received 
and read, the characters may be written at step 312. For example, If the character V Is received, the letter V may be 
written to a display device so that the character *e" may be viewed on the display by the user. A determination is made 

20 at step 314 whether a received character Is an accent Indicator character. For example, the apostrophe character f ) 
may be assigned as the accent indicator character. A determination is made at step 31 6 whether a vowel precedes the 
accent indicator character. In the event a vowel does not precede the accent indicator character, then the accent Indi- 
cator character Is regarded as Intended to represent Its nominal meaning (e.g., an apostrophe), and method 300 con- 
tinues with step 31 0 by continuing to receive further character Input In the event that a vowel does precede the accent 

25 Indicator character, then method 300 interprets the vowel and accent indicator character combination to represent the 
desire to utilize an accented vowel. In this case, the character set for that vowel that includes a range of accented vowel 
characters Is fetched at step 318. Method 300 then deletes backwards two characters at step 320 to delete the vowel 
and accent character tandem. The next character from the character set fe read at step 322 whereby the next vowel 
character is written in place of the previously written vowel and accent indicator character tandem. When step 322 is 

so initially executed, the next character written is the first character in the vowel character set. The next character input is 
then read at step 324, and a determination is made at step 326 whether the next character Input is also the accent indi- 
cator character. The accent indicator character may be repeatedly input (e.g., the user repeatedly hits the accent indi- 
cator character on the keyboard one or more times In succession). By repeatedly inputting the accent character 
indicator, the user Is able to scroll through the vowel character set until the correct accented vowel character is written. 

as In the event the next character is the indicator character, for each input of the indicator character, one character back is 
deleted at step 328, thereby deleting the previously written vowel character, and the next characterf rom the vowel char- 
acter set is written at step 322, and the next character input is read at step 324. This loop may continue until the desired 
vowel character, with correct accent and correct punctuation, Is written. When the vowel character set Is fetched at step 
316, the vowel character set may be written in a circular buffer so that when the end of the vowel character set is 

ao reached, the vowel character set may be read again from the beginning at the first vowel character upon successive 
input of the vowel Indicator character. In the event the next character input Is not the vowel Indicator character, for exam- 
ple, a space character, the next character Input Is written at step 330, and method 300 may continue at step 322. 

Accented Character Sets 

45 

[0043] The user may be provided with one or more available accented character sets depending upon the level of 
writing desired For example, at least one or more of the following accented character sets may be available: 

$etl\<f> □ B & * * i] 

so 

Set 2: [ I * J* _ A ] 

Set3:[f H - S] 

55 

Set 7 may be described as comprising characters: lowercase *a M with grave accent, lowercase V with acute accent, 
lower case "e* with grave accent, capital "e* with grave accent, lower case T with grave accent, lower case "o" with 
grave accent, and lower case V with grave accent. Set 2 may be described as comprising five characters: capital "a" 
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with grave accent, capita/" V with acute accent, capital V wKh grave accent, capital V with grave accent and capital 
V with grave accent Set 3 may be described as having four characters: tower case T with circumflex accent, capital 
T with circumflex accent, lower case "o" with acute accent, and capital V with acute accent. 
(0044] Character sets may be selectively available depending upon the needs of the writer and the level of formality 

5 required. For example, only Set 1 may be available for very simple Italian writing style such as for personal correspond- 
ence. For writers requiring accented capltaJ letters, for example when writing titles, Set 1 and Set 2 may both be avail- 
able to the user or system. For more demanding writing, Set 1, Set 2, and Set 3 may be available, for example, when 
a higher level of formality is desired. One or more vowel character sets per vowel may be created based upon the avail- 
able character sets. The created vowel character sets may also include essential accented vowels with punctuation as 

to necessary so as to be able to discriminate between accented vowels, with and without punctuation, and non-accented 
vowels, with and without punctuation. For example, the following vowel charactersets may be created if only Set 1 were 
available: 

Seta, [a <P c*o ao] 

IS 

&/e: (e I □ Bo Do ea] 
SetE: [E 6 Ao j|a] 
Sett: [® * *o <D<o] 

20 L 

etc. 

If Set T, Set 2, and Sef 3 were all available, Set a and Set e are unchanged, but Set E and Set /, for example, are 
25 enlarged to include the additional available characters. Thus, new and/or enlarged vowel character sets may be created 
as appropriate: 

SetE: [E A Ao J- *o &fco] 
30 Seti: [<D * *o rf 1 ^o (Do] 

Set I: [L m j*o B Ho fro] 

etc. 

35 

The vowel character sets may be ordered or sorted according to the frequency of occurrence in the language of interest 
such as Italian so that the most frequently occurring character will be selected first, the second most frequently occur- 
ring character will be selected second, and so on, in order to maximize the efficiency of selecting the desired accented 
or non-accented, punctuated or non-punctuated vowel. 

4o [0045] Referring now to FIG . 4, a flow diagram of a method for processing text in accordance with the present inven- 
tion will be discussed. Method 400 is executed by system 1 00, and In one particular embodiment, by computer system 
200. Method 400 is utilized to create and modify the character sets used by system 1 00 for a given language. A desired 
language is selected at step 410. One or more character sets for the selected language are fetched at step 412. One 
or more of the fetched character sets are selected at step 416 according to the style and formality of language to be 

45 utilized. A punctuation level is selected at step 418. The next character set to be used is read at step 420, and the next 
character is read at step 422. if there Is preexisting a previous vowel or character set, such a determination Is made at 
step 424. If there is no previously existing vowel or character set, a vowel or character set Is created at step 428, and 
the character is added to the vowel or character set at step 430. If there Is a previously existing vowel or character set, 
a determination is made at step 426 whether the character is a new character, and if so, it is added to the previously 

so existing character set. Otherwise, the method continues at step 432. If an end of the vowel or character set is not 
reached as determined at step 432, then additional vowef or character sets having additional vowels or characters are 
created. A determination is made at step 434 whether the character sets are completed, and if not, method 400 contin- 
ues execution at step 420. If the character sets are completed, vowel and character sets are saved in system 100 at 
step 436, and method 400 ends at step 438. 

55 [0046] Referring nowto FIG. 5, aflow diagram of a method for processing text in accordance with the present inven- 
tion will be discussed. Method 500 begins with the selection of automatic mode at step 510. Text input data is received 
at step 512, such as from keyboard 112, file 114, microphone 116 via speech-to-text engine 118, graphical image file 
120 via OCR 122, etc. The text input data is read for a predetermined character sequences at step 514. For example, 
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the occurrence of an activator event such as an apostrophe followed that is preceded by a vowel is read and detected. 
A determination is made at step 516 whether a role for the read sequence is found, for example is a rules list If a rule 
for the read sequence is found, the word is corrected at sep 528, for example by removing the text sequence and replac- 
ing ft wtth a corrected sequence For example, a vowel foDowed by an apostrophe Is replaced with an accented vowel 

s character according to the rule for the Input character sequence. If the rule tor the Input character sequence is not 
found, a wordlist is searched at step 518 for a correctly accented version of the Input word according to the read text 
Input data, if the word Is found, the word is corrected at step 529 wherein In the wordlist replaces the word In the text 
input sequence. Otherwise, a vowel fist is searched at step 522 for a list of possible accented vowel sequences accord- 
ing to the read Input sequence. If a vowel sequence Is found, the word Is corrected according to the vowel sequence at 

,o step 528. Otherwise, a fallback rule Is read at step 526, and the word is corrected according to the fallback rule. 

[0047] Referring now to FIG. 6, a method for processing text in accordance with the present invention win be dis- 
cussed. Method 600 begins with the reception of a word to be processed at step 610. The word is normalized at step 
612, for example any accented characters are ignored as far as the present accenting Is concerned so that the 
accented character is treated as fts root letter character, and optionally as the root letter followed by an activator event. 

is Alternatively, extended character set representations of words, such as 8-bit ASCII, are normalized by being converted 
to 7-toit ASCII character set words. The ending vowel, if any, is determined at step 614, a corresponding vowel list is 
fetched at step 616. The word is compared to the vowel list at step 618, and a determination is made at step 620 
whether a match In the vowel list Is found. This process continues until a match Is found, at which time the accent or 
punctuation information is returned. A determination is made at step 624 whether to apply the returned accent or punc- 

20 tuation information, and If so, the word Is modified accordingly at step 626. In the event It is determined not to apply the 
returned accent or punctuation information to the word, the word is left unaltered at step 628, and method 600 continues 
at step 630 for additional words. 

Overriding Automatic Action 

25 

[0046] System 1 00 is capable of overriding or correcting an automatic action generated by system 100, and is fur- 
ther capable of remembering the override event to be applied in future events. Possible variations and extensions, 
Implemented In software, range from a way to use the intercepted Input to take quick notes and then paste them, to a 
way to generate different currency symbols using a single currency key or symbol- System 100 places an information 
30 box near the current cursor position, with notes about correction that was made or future results of repeated presses. 
The following are examples of different actions that can be performed by system 100 described herein. 



User mput 


System Output 


Note 








e' 


e 


Changed to grave e 


e 


e 


Changed to grave e 


perche' 


perche 


Changed to acute e 


perche 


perch 6 


Changed to acute e 


po' 


po' 


Unchanged (correct) 


po 


po' 


Changed to apostrophe 


po' 


po' 


Consistent apostrophe style appfied 


qua 


qua 


Accent removed 


qua' 


qua 


Apostrophe removed 


qua!' 


qual 


Apostrophe converted to space 



[0049] The above examples reflect rules that are built into the algorithms for Italian which are part of system 1 00 In 
55 an Italian based embodiment. These rules ensure that system 100 exhibits a reBabHrty exceeding 99% without even 
requiring an exhaustive dictionary of words. 

[0050] The following examples show the effect on a more dynamic situation, where the user repeatedly presses a 
certain key to intentionally achieve certain results (even overriding Italian rules, in an Italian context). 
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User Input 


System Output 


Note 


5 












po 


Second press of starts loop 




e* | 


6 


First apostrophe = e, second = e 


to 


e m 


e 


Third press = e 




e"" 


e' 


Fourth press = e' 






e' 


Rfth press = ©' 


1S 




e 


Sixth press restarts from e 




e 


No change 




ee 


e 


Same loop as that activated by — (e is 
easier to reach than 6) 


20 


$ 


$ 


No change 




$$ 


□ 


Second press = euro sign 




$$$ 


¥ 


Third press = yen sign 




$$$$ 


$ 


Back to step 1 


25 


oe 


oe 


No change 




066 


a 


Second press of - e" starts loop 






oe 


Third press toggles back to beginning 


30 


06 


6 


Variant of the above 




oee 


oe 


Loop like above, but In different order 




6 


6 


No change 


35 


6o 


oe 


Same loop as that activated by "e" (less 
practical, though) 




ss 


ss 


No change 




sss 


B 


Triple s begins German sharp-s/ss loop 


40 


ssss 


ss 


Back to step 1 



[0051] The above are some examples of what system 100 executes In a "dynamic" mode. The dynamic mode 
causes different characters to be displayed one after the other which, when system 100 is implemented as a keyboard 
hook, is achieved for example by sending fake character and backspace inputs to system 100, and can be applied in 

45 different ways based on different activator event keys, different output sequences, which can be static or dynamic, e.g. 
•learning" from past selections, and also in combination with Italian rules to generate the most likely desired output first. 
Variations include/for example, causing an above w ss" cycle to break the loop after the third V is pressed so that 
repeated actuations result in the same amount of V characters, or the insertion of Just one more step to generate three 
V characters in a row, but then restart from "ss D , "0", etc. The loops can be dosed, beginning again from a certain step, 

so which is not necessarily the first step, such as with a circular bufler, or open wherein after a predetermined number of 
identical inputs, the output becomes identical with the input and consist of any number of entries. 
10052] A learning mode is provided by system 1 00 where the most frequently used character or currency symbols 
could always be output first in the loop, depending upon the statistically most encountered selection. The examples 
illustratat that system 1 00 is capable of utilizing more than one activator event, for example, apostrophe, accented char- 

55 acter. specific currency character, generic currency character, to access a given character loop or set. Thus, with some 
keys and characters, such as apostrophe, are utilized generally and combined wfth a previous character, while other 
keys and characters, such as accented characters, serving both as a reference to a base character and also as an acti- 
vator event. 
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[0053] The order according to which the Items in these dynamic loops occur are defined as static (program- 
defined), static (defined by user In program settings), dynamic (frequency-based), dynamic (frequency-based, with 
optional adjustable limit before changes occur), and dynamic (combination of the previous ones with Italian language 
rules which to calculate the most likely cases). For example, system 100 could be programmed In a manner such that 
5 the order in which the items appear Is changed only after two (or one, or three, or more, etc.) consecutive selections of 
an item which Is not already at the first place in the list, or It could be set such that the order changes after the total 
number of selections in a given timeframe, which can be unlimited, I.e., not time related at all, and Is such that a certain 
item is desired over another one at least 5%, or 1 0% more times, etc. 

[0054] The first press of an apostrophe automatically outputs a word, or character having the correct accent in 

10 accordance with the rules described herein without further user intervention. Subsequent consecutive encounter or 
actuations of the activator event, the apostrophe, activate a dynamic manual selection mode, Other peculiarities of Ital- 
ian are also considered. For example, instead of, or In addition to, an apostrophe key or character as a desired way to 
initiate the automate placement of the sign which 9ystem 100 determines to be the best, since in Italian a vowel never 
appears twice, each vowel itself could act as an activator event which, encountered or pressed more than once, initiates 

15 a character selection loop. System 1 00 may be programmed to Implement this and other similarly based modes. 

[0055] A rule-based approach is also possible for languages such as German which has the special characters 
"aYo", "0\ H B", "A", "6", "0", where the context can facilitate system 1 00 to determine whether *oe' Is more likely to 
mean Wthan a 6\ for exampte, and propose that as a first choice when the user writes •oe", and the other when the 
userpresses V again ( a oee # = "6"). As with an Italian embodiment, repeated Identical characters could be used Instead 

20 of the vowel + "e" combination. 

[0056] Additional ways for the user to specify a certain accent may be Implemented by system 100. For example, 
the user could use the characters V or A\ or both combinations thereof to indicate a circumflex accent before the apos- 
trophe to quickly specify the accent. For example, W would mean T and "aT would mean - a \ and W or "aA" 
would mean •fl". Another variant is the placement of the symbols before the vowel, as in Aa", etc. 

25 [0057] System 1 00 provides different ways for the user to override system 1 00, and Just enter exactly what is typed. 
System 100 can for example use the Nurn Lock key for this purpose. On one hand, system 100 ensures that Num Lock 
is always switched on if the user desires, and on the other it then interprets any Num Lock actions as on/off commands 
for Its text processing system as described here. The Num Lock Is a key that effectively has little practical use, so this 
action provides two benefits In one. Scroll Lock or other keys could also be used in a similar manner. For temporary 

30 on/off, it is possible to hold down certain keys while entering text that would otherwise be modified. The user can go 
back after an automatic correction, and rewrite the text so that it is not modified a second time. 
[0058] Examples of additional program options include a setting to make sure that accent changes in the middle of 
a word, as opposed to changes at the end of a word, are applied only while typing, and not on file operations. This would 
be in the assumption that accents placed in the middle of a word, for example which typical Italian never uses, have 

35 been placed with proper knowledge. More options provided by system 100 include the possibility to scan a text file for 
patent character set errors, which might for example have lead to the word "perche" to become "perchX- or -perchf. 

Input and Output Interfaces 

40 [0059] Depending on the hardware and software with which system 1 00 of the present invention is utilized, exam- 
ples of sources from which input data can be acquired Include the operating system, an input method system interface, 
an error-handling interface, an accessibility interface, e.g., as used to handle input, output and context for blind users, 
or an application such as piece of software, or the keyboard system or other hardware, or display memory, or computer 
memory. Text context data is acquired either from the operating system, or from an input method system interface, or 

45 from an error-handling interface, or from an accessibility interface, or from an application, or from display memory, or 
from computer memory, or by buffering the Input data. Output is sent to the operating system, or to an input method 
system Interface, or to an error-handling interface, or to an accessibility interface, or to an application, or to the part nor- 
mally receiving data from the keyboard system. If the input stream cannot be intercepted for exclusive use, then output 
Is generated in a way as to produce the deletion and replacement of the parts that require modification, for example by 

so inserting 'cursor, "backspace" and "delete" control commands as appropriate. 

Input and Context 

[0060] System 100 recognizes certain input events as causing a disruption ot context, requiring the collection of 
55 new context information. For example, when the user moves the cursor with the mouse, or moves the cursor up or 
down, or selects an application command via the mouse or keyboard, system 1 00 takes steps to try to reconstruct the 
new text context, i.e., the text surrounding at least preceding the new cursor position. Modem operating systems, such 
as MICROSOFT WINDOWS, provide dedicated interfaces for this purpose, designed to give text context data for acces- 
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elbttlty purposes, e.g., to read out the current text context to a Wind user, or as part of an input method system which 
system 100 described here embodies for languages such as Italian, ft context collection through this type of system 
calls is not possible, It may still be possible to obtain equivalent information directly from the application being currently 
used. For example, applications such as MICROSOFT WORD provide such information. On systems where neither the 

5 application nor the operating system provides such information, ft Is always possfole to bufferthe Input data as ft Is being 
typed, and resort to that information as the context data. However, when the text contBXt is lost, for example after a ver- 
tical cursor movement, It Is desirable to utilize different techniques to collect text context information, at least for the part 
immediately preceding the new cursor position. On-screen optical character recognition (OCR) is one such option. Sys- 
tem 1 00 employing on-screen OCR recognizes the cursor because It Is the only object on screen that flashes. Alterna- 

10 tively, system 100 queries the operating system, and then analyzes the surrounding screen bitmap for text patterns. 
Other techniques are also utilized For example, with certain operating systems and applications, it Is possible to 
directly access the region of memory that provides the necessary text context Information. Where no context Is availa- 
ble, system 1 00 utilizes generic, not context-specific, likelihood rules. 

is Context Information 

[0061] Context information provides the following data: the last, current, word up to the current insertion or input 
point, information on whether the context before that word required a capital initial, that is an upper case character, 
information on whether the context before the current Insertion or Input point Includes a single opening quote with no 

so corresponding closing quote, and text language forthe block Including the last word, if specified by the user or otherwise 
known. For one embodiment of system 100 in accordance with the present invention, for example on a slower system, 
word context information alone, such as the test word, could be sufficient, depending on the requirements concerning 
execution speed, memory use and output quality. Word context b an Important piece of context. Even partial word con- 
text is useful, for example when the language rules include suffix rules. 

25 (0062] The special handling of a single quote character is utilized for Italian and other languages where one embod- 
iment utilizes the apostrophe character, or possibly any character resembling it, such as the "acute" character, as an 
activator event Defined as variables, in a possfale implementation the context variables could be: 

context.buffer = context string and data 
30 contextword = string 

context capital = yes/no 

contextexpectsinglequote = yes/no (or counter) 
contextlanguage = language code 
context typemode = insert/overstrike 

35 

[0063] These variables are provided by the host environment, such as the input method Interface, word processing 
application, etc., or are calculated by system 1 00. 

[0064] in the context of an interactive use, for example system 1 00 applied while the user is typing, context.buffer 
is an optional copy of the local text region, which is dynamically maintained by system 100 while the user is entering 

40 text. The purpose of this data is to be able to provide Information about the current word, i.e., to construct contextword, 
when system 1 00 Is applied to an environment where the application in use, or the operating system, are unable to pro- 
vide text context information. This data consists of a string of characters that represents a "sliding window* region of the 
text currently being typed, plus status variables that indicate the cursor position with respect to the buffer, and the size 
of the buffer. When the user types characters of text, these are appended to the string in context buffer until a maximum 

45 size has been reached, after which new characters are added, and old characters are discarded from the buffer, as nec- 
essary to maintain the maximum buffer size where one has been set Depending on the Implementation, characters 
may be discarded at the beginning of the text buffer, but not at the current word, if the cursor is at the beginning of the 
buffered data, or at the farthest point from the cursor position, or using other preferences. When the user uses the cur- 
sor left/right keys to move the cursor in the application currently in use, the cursor position in the local buffer is also 

so updated accordingly. During cursor left/right events, the cursor position may temporarily fall outside the current window 
of buffered characters without requiring the buffer ItseH to be reset, but if text is then added outside the buffered region, 
then the butler contents may be reset, as the contents of neighboring regions of text is unknown. The context buffer data 
also Is reset when the user uses the cursor up/down keys, or when the mouse is used to move the cursor, or to execute 
commands, or when certain combinations of keys are pressed to execute a command, if system 100 cannot determine 

55 how these events affect the text currently being written. 

[0065] A word as stored in context. word is defined as a sequence of characters building a single word, such as It 
would appear in a dictionary. This includes, without being limited to, letters, digits, and the dash sign. An apostrophe 
sign before a word is not considered part of the word for the purposes of one embodiment of system 1 00. An apostro- 
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phe sign, or other sequence of one or more non-word signs after the last letter of a word Is processed as a possible 
activator event sequence when system 100 is applied to Italian and certain other languages, ratherthan being accepted 
without action as part of that word. If the word oontext cannot be determined, either interfacing wtth the application, or 
Interfacing with the operating system^ or through the local context buffer contextbuffer, then the word context string is 

5 left empty. This may for example occur If system 100 is poorly integrated with the host environment, so that context Infor- 
mation can only be acquired through buffering of the input characters, and is lost after vertical cursor movement A 
buffer holding more context text than the current word is both desirable and useful, as It avoids having to request context 
Information, which may also be unavailable, to the operating system or application after horizontal cursor movement 
and text deletions going backwards beyond than the current word. A possible Implementation is circular text buffer of 

to constant length, from which the current context word is derived as necessary. 

[0066] The variable contextcapttal is set to yes if, according to the punctuation or other context attributes (e.g., 
beginning of sentence), me word stored in contextword would need to be capitalized. This Information is not used for 
capitalization purposes, but rather because some accent rules need to know if an unknown word is likely to be a proper 
noun or not, and proper nouns can be recognized by the capital initial, but only if such capital initial Is not context-spe- 

is cific. The variable contextexpectsinglequote would be set to yes If it was determined from the context that, within a cer- 
tain range, the maximum of which can be specified, e.g., as one or two sentences from the current position, or as a 
certain number of characters or words, going back from the current position, certain characters were found which are 
normaOy used as an opening sequence for certain types of quotes for which the closing sequence may consist of one 
or two consecutive apostrophe or grave characters, but no such closing sequence was found. Knowledge of this is val- 

20 uable because if an apostrophe is for example found immediately after an unknown word, especially where It Is Intended 
to produce good results even with unknown words, it might indicate an accent or instead a closing quote. Certain rules 
for placing accents where automatic correction is desired and no user preference Is given leave an apostrophe or grave 
character unchanged after an unknown word, If a closing single quote Is expected. A single opening quote is In general 
defined as an apostrophe sign (decimal ASCII code 39, or similar characters), a grave character (decimal ASCII code 

25 96, or similar characters), or a comma (decimal ASCII code 44, or similar characters) Immediately preceding a word. 
An additional optional condition to recognize such an opening sequence is where the sign does not immediately follow 
a letter, or where it immediately follows a space, line feed, or appears at the beginning of a sentence, or where it imme- 
diately precedes a letter. The sign may also appear twice, l.e., consecutively, or for example in single-quotes within dou- 
ble-single-quotes within double-quotes, In which case h is expected that the contextexpectsinglequote condition be not 

30 cleared until all quotes are matched. For this purpose, a counter field to this information is associated. The con- 
textexpectsinglequote condition is cleared after a certain number of characters, words or sentences, in order to avoid 
the carrying over of possible interpretation errors. Furthermore, the single quote counter is not be increased or 
decreased for single quotes that are recognized as having a specific purpose that does not require paired sets of 
quotes. This applies, for example, to single quotes appearing as part of a quoted possessive or negative or known 

as abbreviation form, as In -Will said 'Don't play with Mary's ball before 5 o'clock, or I'll be very angry,' and went to work." 
Known patterns such as "*T, "V, V", "*T f denoting any word-string) could be part of a list used to exclude certain 
single quotes from the count of opening and closing quotes. 

[0067] The variable context language Indicates the language of the current context. This Is used by certain accent 
rules because, If a word requiring accent action Is found that Is unknown, then no action should be taken if the word is 

40 known to be not Italian or another language for which this system can be applied. As an example, if the Implementation 
Is based on a set of suffix rules, with optional dictionary words, usually providing exceptions to rules, and where a word 
does not match any dictionary entry, system 1 00 applies rules, and If no rule is found, a fa! back rule, for example, a rule 
saying that if the last letter of the word is V. then an activator event after the last vowel would mean that the "a" should 
be converted to an "a*, would be applied. If the host environment such as the operating system, or application, provides 

45 no language information, a method is used to Identify Italian text by comparing all bigrams (letter pairs) In the current 
word with a table of bigrams used In Italian. This technique occupies about 100 bytes of memory to store blgram data 
tor all possible pairs, is fast, and for Italian provides reliable results because Italian uses only a small part of the possible 
two-letter combinations, about only one third of all possible combinations. The table of bigrams is stored so that each 
possible bigram is represented by one bit, which is set to 0 or l to indicate that that bigram is used in Itafian, or other 

so language to which this invention is applied, or is not A bigram language analysis is fast and improves the reliability of 
accent rules on slower systems where a word-based analysis using a whole dictionary of stored words or other tech- 
niques might use too much memory and execution time. 

[0068] The variable context, typemode indicates whether, during interactive text Input mode, text is being inserted, 
i.e., text to the right of the current cursor position moves to the right as new text is entered, or overwritten, i.e., new char- 
55 acters replace existing characters. This information is used both to appropriately update the local context buffer, and 
when sending fake input characters to replace one string with a new one. For example, in insert mode, to replace a 
character with another one the user, or a system simulating user input, presses the Backspace key followed by the new 
character. In overstrike mode, however, the user uses the Cursor teft key instead of Backspace, or otherwise one char- 
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acter of unrelated text following the replacement point Is lost Alternatively, the user, or system 100 simulating user 
input, temporarily changes the TypeMode as appropriate before text Input, and then restores the original status. The 
TypeMode ts typcially changed with an appropriate application or system command. Under MICROSOFT WINDOWS 
and other operating systems running on PCs the TypeMode Is changed using a dedicated keyboard key, named Insert 
Use of this key te Intercepted or simulated as necessary. Applications typically Initiate In insert mode, with a few excep- 
tions starting In overstrlke mode, such as the MICROSOFT WINDOWS Command Prompt window, which are known, 
and/or which the user may want to program with appropriate settings, and system 100 described here must keep track 
of all actions which affect the TypeMode status. A few applications use the Insert key for other purposes, for example 
MICROSOFT WORD can use it to insert clipboard text, but these same applications usually provide an Interface wtth 
TypeMode status information. On other systems and applications, equivalent keys and commands are detected and 
simulated as necessary. 

Activator Event Sequences 

is [0069] An appropriate activator event character for Italian is the apostrophe. The function of system 1 00 described 
herein lies in the algorithms employed to ensure that the apostrophe character is properly converted to an accent, or 
left as is, or recognized as an error and therefore totally removed from the input stream. The acute character, the char- 
acter under the tilde character on US keyboards, may be utilized Instead of the apostrophe, or to explicitly set one type 
of mark instead of the default one placed by the apostrophe sign. 

20 [0070] For one embodiment of the Invention applied to Italian, accented vowel characters that are present In the 
input stream are processed as if they were two separate characters, namely, the vowel character plus the activator 
event expressing an intention to select an appropriate character, different from an exact character. This Is equivalent to 
an occurrence of the vowel character followed by an apostrophe character, with the exception that the considerations 
dealing with possfole single quote character ambiguities, for example a closing quote character, do not need to be 

25 applied. It te effective to treat accented vowels appearing in the text stream using an interactive mode, for example when 
the user is typing, and only If such accented vowels appear at the end of words, and optionally unless they are not pre- 
ceded by an apostrophe, when working on file or clipboard data. Accented vowels appearing in the middle of words are 
usually not Italian, and are written by more sophisticated writers who intentionally utilize such characters, and an Inter* 
active mode provides additional control to correct or change the proposed accent or apostrophe. In other words, in an 

30 interactive mode it Is fine to take action one letter after the other, as they are typed, and the concept of inside a word 
does not exist, because during normal typing of a word letters are always at the end of the partial word. System 100 
described herein provides an intuitive way of looping from one character to the other. On file and clipboard data, system 
1 00 determines when something occurs at a true end of a word, and there is no option tor user interaction, so changes 
in the middle of a word are normally not applied, unless specific user settings or dictionary entries require such a 

35 change, or at least not based on generic suffix rules alone. Thus, in one embodiment of the invention, accented char- 
acters appearing at the end of a word but before an apostrophe are left unchanged. 

[0071] Certain characters (V, V, T, apostrophe, acute, etc.) are optionally utilized by system TOO to explicitly 
express what type of accent or apostrophe Is placed. This provides one way to handle exceptions. It may not be utilized 
by an average writer, and in an alternative embodiment the dictionary is extended, rather than to using such a method 
ao when typing. This method Is useful to handle exceptions when encoding accented text as 7-blt ASCII, for future re-con- 
version. 

[0072] Repeatedly pressing an activator event during text Input toggles the state of different diacritical signs, such 
as acute, grave, circumflex, apostrophe, umlaut, no sign, etc. This set of signs, as well as the desired order, is based 
on language, user settings and optionally on dynamically adapted based on the frequency of previous selections. In 

45 other languages (non-Italian), or tor language-neutral applications, such as for entering currency or other symbols that 
are not present on a keyboard, this embodiment Is used In combination wtth certain predetermined sequences of char- 
acters that normally do not occur in normal text For example, currency symbols are usually never used more than once 
in a row, so the repeated pressing of a currency character, e.g., *$", could be recognized and processed as an activator 
event by system 100, initiating a certain action. In many languages, action is initiated after a.certain character Is 

so pressed two or three times, or when this is done one. two orthree times after a certain context, for example, in German, 
repeating "e" after an existing "ae", "oe" or "ue" initiates a loop toggling between the two letter pair and the first letter 
with an umlaut. 

Automatic Changes and User Re-correctlons or Further Modifications 

55 

[0073J When system 100 is utilized in an interactive mode, for example during typing, a loop providing multiple 
options is Initiated it following an automatic change. Also loop is initiated to more simply override the automatic change 
and to manually enter some text The user additionally has other manual ways to input sequences which would normally 
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be changed by system 1 00, such as certain combinations of characters which might otherwise Initiate an IME loop that 
does not include those combinations ot characters. This Includes using traditional text editing sequences to input one 
character at a time, separated by a space character, and then removing the space character. Even after very short use 
of this system the user becomes familiar and comfortable with the fact that certain actions result In automatic changes 
5 and loops, and because these automatic actions are very predictable, the ways to avoid them, If necessary, also come 
very natural to the writer. 

Rules and Data Structures used for Italian Text Input 

w [0074] When system 100 Is utilized wtth Italian, in which case the considerations using apostrophe and accent 
characters apply, reliability is provided when automatically producing a correct output on a first try, without requiring 
additional user feedback or efforts. System 100 automatically places an appropriate accent or apostrophe mark at the 
end of words, which in general means on or after a vowel. For one particular embodiment, It is sufficient to utilize a set 
of word suffix pattern matching rules, with appropriate priorities, and default fallback cases. Specific words may be 

is included in the rules, mainfy to define rules and exceptions that are associated to certain exact words, rather than to 
groups of words ending with a certain suffix. 

[0075] In certain cases a word is written in a particular way rather than being based upon an assumption for a 
sequence ot suffix rules, for example to produce a positive match on a foreign word, or one that had not been consid- 
ered as an exception. Such as case is, for example, when the user is writing Inside a single-quote context In such a 

20 case, system 1 00 considers that an apostrophe character after a word which In the dictionary explicitly appears Is writ- 
ten with a certain accent or apostrophe is not a closing quote, but rather should be transformed into an accent, whereas 
if instead the word does not produce an exact match, but rather only satisfies the suffix rules, then system 1 00 displays 
an information box and optionally produces an audio cue. while producing a default output The default output In such 
uncertain conditions, for example where there could be a closing single quote, or an accented unknown word, Is based 

25 on statistical considerations about the likelihood of a closing quote at a certain distance, for example measured In char- 
acters, or words, from an opening quote, as opposed to the statistical likelihood of an accent sign on an unknown given 
word. This information, together with accents on words that match suffix rules, but not exact word entries, are collected 
and remembered by system 1 00 by being stored, so that user choices progressively converge so that system 100 pro- 
duces better results on a first try. 

30 [0076] In an alternative embedment, an exhaustive dictionary of words, in addition to suffix rules, in an editorial 
context is provided. A professional publishing house might have a policy to check every single word. In such an embod- 
iment, even when the suffix rules produce the correct output, a warning Is Issued informing the user, that a word Is 
unknown, as Is done for unknown words in general, based on a traditional error.detection approach. System described 
is applied Independently from traditional spelling checkers and similar technologies, In comparison, requires less man- 
as ual intervention, and is more reliable. 

[0077] The data structure presented herein can be used for all of these purposes, integrating a varying number of 
suffix rules and exact word entries, based on accuracy, speed and memory overhead priorities. Even where system 100 
utilizes only a few dozen suffix rules and exception words, a first hit reliability exceeding 99% for the average Italian writ- 
Ing needs is provided in one particular embodiment 

AO [0078] The context language status variable is used to determine whether to apply Italian rules to the text, or not 
This particular embodiment of system 100 employs two additional techniques to prevent possible errors. First is a 
Digram table is used so that Italian suffix rules are not applied to words that contain one or more, blgrams that do not 
normally, occur in Italian words. Second, a list of certain word patterns Is provided for words which In English, often used 
in an Italian context are associated to an apostrophe sign, and which do not occur in Italian. English words ending with 

45 a vocal and which are more frequenuy followed by an apostrophe (e.g., T, "he", •she"), and which do not have an Italian 
accented equivalent, are listed together with other Italian words, but wtth appropriate flags Indicating that these words 
are not normally accented, Le., system 1 00 does not convert an apostrophe after these words to an accent, which Is a 
default action for Italian, unless a word is known to occur with a final apostrophe. Additionally, system 100 includes a 
special list of words, rules with a POSTAPOSTROPHE flag, which are known to only exist after an apostrophe, and 

so which are used in English, such as: V (also used in German), \f , H*. *ve w and "em". When the user writes a word, end- 
ing In a vowel and followed by an apostrophe, and the Italian rules, possibly a suffix or fallback rule, cause the word to 
be accented by system 1 00, and then these known "post-apostrophe" words occur, and then the word ends, system 100 
restores the previously changed apostrophe. For example, considering Til go home", system 100 recognizes T as a 
word which can be either without accent in Italian orfoflowed by an apostrophe in English, but never accented, not even 

£5 in Italian, and leaves the apostrophe as is. Had the entry for the word T not indicated that the word does not exist with 
an accent, system 100 is still able to retroactively correct a change from apostrophe to accent after checking the "ll* 
word, as is done for the case below. 

[0079] Considering "Gina's car is red", system 1 00 may initially convert "Gina" to "Gina", assuming that no exact 
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entry for "Gina" exists Indicating that the accented TBina" does not exist, therefore applying a generic suffix or fallback 
rule, but then, after the following non^word character, system 1 00 recognizes the apostrophe + V pattern, and restores 
the apostrophe. 

[0080] In one particular embodiment, the data structures for Italian consist of a series of lists which all deal, in one' 

5 way or another, with apostrophe and accent Information. The Bats consist of five sorted lists (*A B , *E W , T, "O", "U"), each 
containing rules for word and word suffixes ending with the corresponding vowel. Each entry can refer either to a word 
suffix, that Is to a group of words ending with the same suffix, or to an exact word, and can have one or more flags. One 
optional list of words ending with a consonant Is provided, but which are nevertheless frequently written followed with 
an apostrophe even if no apostrophe should be placed after the word. For example, the list contains an entry indicating 

w that the word "quar Is never to be followed by an apostrophe. In this case, as explained In the general overview, system 
100 replaces the apostrophe with a space character. These entries usually only have the NOTHING flag. One list of 
replacement rules is also provided. These can optionally be enabled to place accents Inside certain foreign words. For 
example, a rule could say that If the user writes "Cezanne", the word is automatically be converted to "Cezanne'. These 
rules, like the rules for words ending In a consonant, complete system 100 In an optional way in that they can be option- 

75 ally provided, and do not affect the main feature of Input method editor functionality. One optional list of words includes 
mat are known to occur after other words separated only by an apostrophe character is optionally provided. These 
entries Include mostly particles, such as V for EngOsh and German possessive forms, 'd", "ir, *ve", etc. This list ena- 
bles system 100 to posthumously recover from certain Incorrect changes that might have been applied as a result of 
suffix and fallback rules included in the five vowel lists. As a result of this list system 100 becomes more reliable even 

so when writing for example In English, and when language detection Is not possible. 

[0081] Word and suffix entries In the lists are case, accent and apostrophe insensitive, that is the entries produce 
matches ignoring accent, apostrophe and case Information. This is also referred to as normalized. The entries only con- 
sist of the letters "a" to V, and the dash symbol (■-■), if surrounded by other characters. One asterisk character Is used, 
at the beginning of an entry, to Indicate that the entry refers to a word suffix, and not an exact word (e.g., ~che* vs. 

25 *perche"). 

[0082] The following flags and attributes are optionally associated, also in combinations, to the entries: 

NOTHING: this flag indicates that the word, possibly also, exists without a final accent or a final apostrophe sign. 
GRAVE: the word, possfcry also, exists with a final grave accent 
30 ACUTE: the word, possibly also, exists with a final acute accent 

CIRCUMFLEX: the word, possibly also, exists with a final circumflex accent 

APOSTROPHE: the word, possibly also, exists with a final apostrophe immediately following the last letter 
APOSTROPHE RARE: used with APOSTROPHE, meaning that usb of the word with apostrophe is very rare. The 
user may decide to set system 100 in a way that the word is not considered to have APOSTROPHE if APOSTRO- 

35 PHERARE is set, which would improve the automatic detection of certain common apostrophe and accent errors. 
INFORMATION=string: This is an information text that may be displayed as a tool tip above the cursor position, or 
elsewhere on the screen. It could say something like: This word is used with or without accent Without accent it 
means XYZ. With accent it means ABC* Usually the tool tip is displayed to inform the user that an entry with accent 
or apostrophe is probably not what was meant, I.e., not necessarily an error, but more likely to be one than now. In 

40 the program settings, the user can decide to display different types of messages. 

COMPOUNDSTRICKY: This flag, used with words that have no accents, indicates that compounds of that word do 
have an accent This is a confusing condition for the writer, and this flag allows for a more detailed explanation to 
the user, depending on the desired level of information messages, For example, if the user wrote tre" with an 
accent, system 100 removes the accent and display a message saying that "Unlike its compounds, 'tre* is written 

45 without accent". 

TRICKYCOMPOUND=string: This string attribute indicates the COMPOUNDSTRICKY word of which an entry is a 
compound, for the purpose of displaying complete information to the user, If desired. 

ITALIANIZED <LANGUAGECODE)=string: This attribute and additional string fields indicate that the word is an Ital- 
ianized" version of the word, which in the original language is written differently. Halianization of words is not as fre- 

5o quent today as it used to be, and often resulted in accented words. In modern writing the original words, English, 
French, etc., tend to be more desirable than the old Italianized forms. Appropriate program settings are, for exam- 
ple, used for automatic replacement with the desired word variant to consistently use the Italianized or the original 
forms. String attributes complete the information by indicating the original word, specifying the original language. 
CAPITAL: This attribute indicates that the word to which the rule refers always appears with a capital letter. This 

55 Information Is useful to detect certain proper nouns for which specific accent rules apply. 

TRADEMARK: This attribute Indicates that the word is a trademark or registered trademark. This Information is dis- 
played to the user as part of a view of all the word properties. For example, the entry for the company name # Oc6" 
would be "Oce ACUTE CAPITAL TRADEMARK". 
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WEEKDAY: This flag indicates that the word Is the name of e weekday. Weekday names from Monday to Friday are 
accented in Italian, and represent one of the more frequent instances of errors In which an accent is not written, 
when instead it should be. This flag, in combination wtth an appropriate program option, could be used for auto- 
matic correction of weekday names written without an accent 

TRICKYINSIDB This flag indicates that the word contains accents, but not at the end of the word. This flag Is nor- 
mally only used for non-Italian words, typically French words sometimes used In an Italian context. Uke WEEKDAY, 
this flag allows the program to reduce the computational overhead by limiting the search of words in a non-end-of- 
word-accent context to the words that may require attention even if written without a final sign. 
COMPLEX=string: This string attribute Is used to describe the accents in a usually non-Italian word when the 
attributes forfinal accents (GRAVE. ACUTE, CIRCUMFLEX) are not sufficient, I.e., because the word contains dia- 
critical marks inside the word, and/or at the end of the word, but not of type GRAVE, ACUTE or CIRCUMFLEX. 
FALLBACK: This flag marte the last rule in the first part of the list A fallback rule is of type "a', *V, "T. "*o\ °V. 
i.e., It is used only In the lists associated to words ending with the five vowels, and indicates the fallback rule to 
apply when the previous rules, which are parsed sequentially from top to bottom, produced no match. This flag has 
no functional purpose other than to marie the boundary between the two parts of the list, as explained below. 
POSTAPOSTROPHE this attribute, used In a dedicated fist, maifcs those particles such as the English V and IP, 
which are written after an apostrophe. These particles are used to correct signs Incorrectly changed to an accent, 
which is a condition that occurs when applying Italian rules to non-ftBttan words, as Is the case with words that usu- 
ally precede such particles. At the same time, these particles represent, in many languages, the only cases in 
which apostrophes are used at all. Recognizing these occurrences increases the reliability of system 100 when 
applied to a multilingual context. 

NOTfTALIAN: this attribute is used to allow certain word entries In the rules fists to be recognized as not be'mg Ital- 
ian words, so that they can be considered even if the current language context is not Italian, which would normally 
disable system 100. This allows, tor example, placing the correct accent on non -Italian words such as the noun 
•Jose*, which might normally fall even a simple Italian blgrams test Use of this flag is optional, and also depends 
on the'advantages it brings with consideration to the procedure used for language detection, "rf any. 

[0083] Rags are optionally combined, If more than one flag applies to the same suffix or word. For example, a word 
may exist, with different meanings, with no sign, with an apostrophe, and with an accent. Such a condition is rare, but 

so exists. Great care is placed in compiling the list of rules that are part of the lists, because if a word or suffix rule becomes 
part of the list since in one embodiment system 100 considers all words for which there might be a match, not just some 
words. In one particular embodiment, entries with no flags have no meaning, and are not permitted. 
[0084J For the purpose of determining whether the input of a universal activator event in an Italian context refers to 
an apostrophe, an accent, or an error, in one embodiment system 100 places a higher priority on the collection of data 

35 about words and suffixes that are often incorrectly written with a sign, and those that are written with an apostrophe. 
These two cases, which ere covered through word rules rather than suffix rules, are excluded in an exhaustive way 
before focussing on accents, since accents use more suffix rules, Including fallback suffix rules. 
[0065] . In one particular embodiment the lists are parsed sequentially, top-to-bottom. System 1 00 is optionally mod- 
ified to reduce the number of comparisons, using a variety of possible data structures for sorting and searching, which 

40 are well known. When system 100 determines a positive match between the current word and a rule, the search is 
ended unless a second search Is necessary in the second part of the lists. 

f0086] Rules that represent exceptions to other rules appear higher in the list than the rules of which they are an 
exception. Rules are also placed higher on the list based on frequency considerations. The 20 most frequently-used 
rules cover more than 90% of Italian accents, which facilitates using a simple sorted list In a sorted list, careful place- 
45 ment of the rules based on frequency is one factor that Improves performance. In on embodiment, rules are preceded 
by their exceptions. For example, a rule Indicating that "che", i.e., words ending with "che\ can have either an acute 
accent or no accent or apostrophe, are preceded by exception entries for words such as "picche", which can be written 
either without any sign or with a grave accent. If a "che" rule is placed on top of the list for frequency or access speed 
reasons, then all of Its exceptions are placed before it as well. 
so [0087] Each of the frve Vowel lists" contains a fallback suffix rule entry (SUFFIX flag), being the shortest possible 
suffix rule, l.e!, the one vowel to which the list itself refers (e.g., -a", "e". etc.), and following all other rules, although 
additional entries may follow in a second part of the list This entry Is also marked with the FALLBACK flag, although it 
could, in theory, be implicitly Identified by the fact that It is a one-character SUFFIX rule. For words ending with a vowel, 
a fallback rule indicates the statistically best fallback description for words ending with each vowel when none of the pre- 
ss vious rules matched. A fallback rule typically indicates that words ending with that vowel either have no sign, or they 
have a certain type of accent For example, the fallback rule for words ending wtth E indicates that those words, unless 
covered by rules appearing higher in the list, have either no sign, or they have an acute accent If for example the user 
writes an unknown word ending with "e', and followed by an apostrophe, system 1 00 transforms the vowel + apostrophe 
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combination Into the vowel with an acute accent (*e"). rather than leaving the apostrophe, because the fallback rule had 
no APOSTROPHE flag. For this reason complete rules are provided that cover words ending with E that are written with 
an apostrophe, or that end with a grave accent, or that are often written with a sign even if they should not, as well as 
additional safety nets to recognize apostrophes that may In tact be closing single quotes, or English or German posses- 
sives, or similar particles used in combination with an apostrophe sign. 

(0088] In one particular embodiment of the invention, when e rule entry contains the flag NOTHING and no other 
flag of type GRAVE, ACUTE, CIRCUMFLEX or APOSTROPHE, and the input contains an accent on the fast character 
of the word, or an apostrophe after the last character, then system 100 removes that sign. If however the sign was a 
sign used as a single closing quote, and the context is such that a single closing quote is indeed expected, then the sign 
Is not removed. Also, ft after the removal of a sign equal orslmllarto an apostrophe, a POSTAPOSTROPHE word string 
follows, as soon as this second word string is complete (i.e., afterthe first non-word character following the string), then 
system 1 00 retroactively re-corrects (i.e. , further modifies a corrected word including undoing a correction) the previous 
correction, reinserting the apostrophe. A peculiarity of writing truncated Italian words ending with an apostrophe is that 
if the last character of the truncated word is a consonant, then the apostrophe also acts as a spacing character between 
that word and the following one, i.e., no space character is used between the two words. System 100 automatically 
removes an Incorrect apostrophe sign by taking this into consideration, in order to place an appropriate space character 
where necessary. As described elsewhere, system 100 provides for different ways to override the automatic removal or 
change of a sign, tor by manual editing or by a repeating Input Initiating an IME loop. 

[0089] A rule entry containing only one flag of type GRAVE, ACUTE, CIRCUMFLEX or APOSTROPHE expresses 
a very dear statement about matching words, indicating that any matching word Is not written without sign, but only with 
a sign, and also Indicating the exact sign. This not only eliminates ambiguities In a context such as that where a closing 
single quote is expected, and the user pressed the apostrophe key, but it is also used to place missing signs when the 
text Input stream did not contain any special signs. This may be implemented as an alternative embodiment. Such an 
embodtnent is optionally enabled for a selection of words commonly written without signs even when they actually need 
one, such as weekdays. In general, the single flag Is used to apply the correct sign on or after a word If a sign was also 
present In the Input text. 

£0090] When a rule entry contains multiple flags, of which one is bl type NOTHING, and only one other flag is of 
type GRAVE, ACUTE, CIRCUMFLEX or APOSTROPHE, then system 100 places the appropriate sign, If an apostro- 
phe or similar character follows the word, or If an accent Is on the last vowel of the word. Optionally, system 1 00 is pro- 
grammed to leave accented vowels, for example in interactive mode, the result of an explicit selection of an accented 
key opposed to the selection of the apostrophe, as they are, and only apply rules logic to the output when apostrophe 
characters, or some other specific activator event, appears in the Input Also, as already mentioned, system 100 is 
optionally set not to apply any changes when accented characters are found Inside, not at the end of, words. This con- 
dition is detected when working on clipboard or file data, and during typing where action Is deferred to when the end of 

the word has been reached. ir _ „ 

[0091] Word or suffix entries with more than one of the GRAVE, ACUTE, CIRCUMFLEX or APOSTROPHE flags 
are rare in Italian, and usually consist of either GRAVE or ACUTE and APOSTROPHE+APOSTROPHERARE. The 
default setting in one ernbodirnent Is to Ignore APOSTROPHE+APOSTROPHERARE flags, resulting in simpler entries 
consisting of NOTHING and/or GRAVE or ACUTE. Optionally, a few entries may remain with more than one of the 
GRAVE, ACUTE, CIRCUMFLEX or APOSTROPHE flags, which may also be combined with the NOTHING flag. In 
these cases, system 1 00 may not automatical^ make changes to the input stream, but instead uses the flags to display 
an information or warning message in case the input does not match any of the flags, or to place certain signs before 
others in the desired order for the IME loop. Statistical analysis of Italian texts has shown that the only cases in which 
multiple flags appear are entries having the form: (with or without NOTHING) + (usually GRAVE, but sometimes 
ACUTE) + (APOSTROPHE, sometimes combined with APOSTROPHERARE), and that the entry may be left unmodi- 
fied if the input contained no accent or apostrophe, and to accept.an apostrophe In the input as the correct accent, 
which is statistically considerably more frequent than the apostrophe, even if APOSTROPHERARE is not present The 
following is a sample entry of such a multiple-flag word, which also includes an information message that system 100 
could optionally display: 

di NOTHING GRAVE APOSTROPHE INFORMATIONS = preposition (as in "di piu M ); di = day, dV = you say 
(imperative)" 

[0092] In one embodiment of the invention, a POSTAPOSTROPHE condition overrides a previous automatic con- 
version of an apostrophe to an accent, or the removal of an apostrophe, even as part of an IME loop, for example with 
a user trying to write "Jose's car is red". Tills Is because a POSTAPOSTROPHE condition typclally indicates a non-Ital- 
ian context in which an Italian word or suffix rule was applied inadvertently, or in which an IME loop was initiated inad- 
vertently. 
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[0093J It should be noted how the inclusion in the rules of English words such as T, •she', Tie', "we", as well as 
proper nouns, ail with the NOTHING flag, as Jong as these words are not accented even In their possible Italian word 
equivalents, combined with POSTAPOSTROPHE entries, creates a double-barrier against possfcte misinterpretations 
and Incorrect changes of apostrophe characters used In a - non-ltallan fashion", as In Til go home". The additional word 
5 entries are useful because the POSTAPOSTROPHE entries cause a re-correction or further modification after the user 
may aJready have been slightly confused by a temporary incorrect change. The additional entries help to prevent these 
rare In an Italian context cases. 

[0094] Optionally, the lists of rules associated to words ending with a vowel may have a second part of entries, after 
the fallback nile. In this embodiment, the second set of entries does not change the results that would be achieved by 

io applying the first set. An entry in the second part conflicting wtth the rules appearing In the first part, Including the faU- 
back suffix rule, is considered an error in the data structure. While the first part of the list has a priority on performance, 
achieved using suffix rules, the second part additionally specifies words, and in rare cases suffixes, that are already 
covered by suffix rules in the first part, but which in the second part are listed in detail. Such information is used to pro- 
duce more accurate results in a context where single quotes are used, or In a more professional editorial context where 

is unknown words should not be processed applying a generic suffix rule, but rather be double-checked manually, as well 
as to provide additional information to the user about an automatic change. When a word, not a suffix, rule appears in 
the first part of the net, that word is considered a positive confirmation that the word exists in Italian, and that it is written 
as indicated by the attributes for that rule. When a suffix rule appears In the first part of the list, then that Is treated as 
a generic rule, and not as exhaustive information. Thus, the NOTHING flag is used on suffix rules that appear in the first 

20 part of the fist. For example, a suffix rule describing words ending with -che" has both flags for NOTHING, and for 
ACUTE. »f the user wrote -afflnche*, system 100 correctly outputs •affinche". However, It the user wrote •affincrte" in a 
context were a pending closing single quote was detected, system 100 determines whether H would be best to treat the 
apostrophe as a closing single quote, or rather as an accent. Different fallback behaviors are defined for these condi- 
tions, including the display of a warning message, and access to statistical data about the likelihood of a closing quote 

26 at a certain distance from the opening quote. In addition to or In lieu of the frequency of an accent on an unknown word, 
tf the second and longer second part of the list, which is accessed in these more ambiguous cases, included an entry 
for "affinche" having only the ACUTE flag, then system 100 determines that the word «affinche" exists, and that the word 
Is always written with an accent, and therefore the apostrophe character was intended as an accent for -affinche". The 
Input of a second apostrophe character, should one follow, Is Interpreted as a dosing quote, 

so [0095] The second part of the list defines in detail, with separate word entries, what should already be Included by 
suffix rules in the first part, but which these suffix rules do not completely describe and at the same time limit in an 
exhaustive and complete way. In addition to the cases described above such as single quote context, editorial context, 
another possible application of the entries In the second part is changing the color of a status indicator from one color 
indicating that a suffix rule is applied, for example yellow, to a different color for example green when an exact word 

as match was found. Also, whereas suffix rules are more open, generally including the NOTHING flag to consider for pos- 
sible unaccented words matching that rule, exact word entries need not do the same unless an exact word can be writ- 
ten both with and without accent, making it possible to automatically add accents and apostrophe characters even If the 
user placed no sign. Except for very specific cases, such as weekdays and a few other common mistakes, such auto- 
matic behavior is not be utilized in one particular embodiment, for example because Italian still has many words that 

40 can be written either with or without a sign, which Is not particularly conducive to safe automatic action, although auto- 
matic action can still be optionally utilized. 

[0096J To further clarify, where system 1 00 includes vowel-lists divided in two parts, the first part is designed in such 
a way that correct output is generated when the user enters, for example, the apostrophe key after a word. The second 
part of the list provides additional certainty, which Is normally not required. The flags for the exact word entries In the 

<5 second part of the list match or are a subset of the flags for the matching suffix rule in the first part. 

[0097} in rare cases it is possible to also use suffix rules as opposed to word rules In the second part of the list. If 
they are used, then the entries are treated as being as -authoritative" as exact word entries. One case in which a suffix 
rule may be used in the second part of the list, for example, is for suffixes such as «ventitre', which means twenty- 
three', and which can be appended to an unlimited combination of other numbers. However, the suffix rule "ventitre' 

so has a string which makes It detailed and precise enough so as to be particularly applicable to words meaning numbers. 
It can safety be used without the NOTHING flag, to mean that all words ending with "venture" is accented. 
[0098J Word entries have the same meaning and are treated the same way both in the first and the second part of 
a list, and do not need to be repeated twice. Suffix rules are authoritative meaning that they give sufficient certainty 
about most or all matching words even in certain unusual circumstances such as single quote contexts. Word entries in 

55 the second part of the list generally do not conflict with suffix entries in the first part where they have either the same 
flags or a subset thereof. 

[0099] Depending on the implementation, it is possible to optionally not include entries for the type of rules 
described as belonging to the second part. Conversely, on a sufficiently fast system, or using different data structures, 
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the two llste are capable of being merged Into a single fist Separation of the lists maintains the first list as short as pos- 
sible, yet where calied for In exceptional cases, additional and more exhaustive data in the second list may be 
accessed 

5 Sample Implementation: Processing of Italian Text Input 

[01 00] In one embodiment of system 1 00, system 1 00 is optimized for Italian writing. In one particular embodiment, 
system 100 is interfaced with a MICROSOFT WINDOWS operating system 126, available from MICROSOFT CORPO- 
RATION, as an input hook wherein system 100 has access to keyboard 1 12 and mouse events as they occur, and fur- 

10 ther provides the ability to simulate keyboard Input Independent of user actuated keyboard Input For example, In a 
particular embodiment where application 130 currently processing input b MICROSOFT WORD, then system 100 
uses specific functions, documented by MICROSOFT, to get current context and language information from MICRO- 
SOFT WORD. Similar interfaces could be used for other programs and for other operating system such as LINUX avail- 
able from multiple sources Including RED HAT, INC., MAC X available from APPLE COMPUTER, INC., etc. where 

15 available. If application 1 30 Is not MICROSOFT WORD, or another application providing access to Information such as 
text context and language, then Interfaces of operating system 126 such as those provided by MICROSOFT WINDOWS 
are used to collect text context, language and current cursor position information. For example, the Interface specifica- 
tions for MICROSOFT WINDOWS include: Active Accessibility and Input Method Editor (IME). Such operating system- 
wide Interfaces only give meaningful results when the user ts writing using an application that provides such data to the 

20 operating system, which in turn can then pass It to an application such as system 1 00. For example, in order to use IME 
functionality, the application used for writing must be IME-aware. Where the application supports no Interface to provide 
text context and language data, system 100 described here can still obtain current word context from the local copy of 
the context which is determined from the keyboard input stream, but which may be lost In cases such as vertical cursor 
movement, use of the mouse to move the cursor, or selection of a command, either via the menu or via a a Keyboard 

25 Accelerator combination of keys. To reconstruct context In this case. It Is still possible to use system 100 functions to try 
and determine at least the text cursor, also calied caret, a blinking fine, block, or bitmap in the client area of a window. 
The caret typically Indicates the place at which text or graphics will be inserted. If it is not possible to determine the cur- 
sor position through system functions, system 1 00 analyzes the display memory to detect a small flashing object. Once 
the cursor position has been determined, In the case of a bitmapped display, system 100 applies optical character rec- 

30 ognition (OCR) algorithms 122 to the bitmap contents, with particular focus on the letters to the left of the cursor. OCR 
122 is particularly effective on screen bitmaps, because the character data is both clean i.e., not rotated or disturbed by 
printing or medium imperfections, and because system functions are used to determine the fonts that are currently in 
use thereby facilitating the OCR process. Since the possible fonts are known, the font possibilities are limited to a par- 
ticular list If the display is not bitmap-based, but character-based, then system 100 extracts text directly from display 

35 memory. In most embodiments, text context is not required to be determined immediately after It is lost following a cur- 
sor relocation. Even where context Information Is desirable, for example where the user moves the cursor and immedi- 
ately afterwards presses the apostrophe key to edit an Italian word, OCR 122 or other context analysis routines only 
need to succeed In obtaining the current word. Even wehre only a few characters before the current cursors can be 
obtained, this Is sufficient to apply Italian rules which In most cases are suffix-based, the ending of words is determinant 

40 of accent information, which is where system 1 00 typically works. For example, In Italian the whole accent and apostro- 
phe issue is typically primarily determined by the suffix of the word. Additionally, because of the statistically unlikely 
chain of events required to occur in orderto result in a possible failure, system 100 functions reliably even when context 
Is temporarily lost as part of normal writing use. On-screen OCR is most likely to succeed on the characters thai are 
determinative, i.e., the current word or at least a part containing the relevant suffix of the current word, because these 

45 parts are most likely to be visible immediately before the cursor position, rather than being located on a different fine, or 
covered by another window. OCR analysis Is optionally closely coupled with an Italian rules parser which stops the ana- 
lyzing of text right-to-left in the event a positive suffix-rule match occurs. 

[0101] If system 100 determines that the text stream needs to be modified, for example to replace a vowel and an 
apostrophe with an accented vowel, system adds artificially generated information to the output stream, generating 

so characters such as a backspace key input followed by an accented character. Where application 130 or operating sys- 
tem 1 28 support this, in a particular embodiment, one string Is directly replaced with another one without requiring sim- 
ulation the progressive deletion of the old string. In either case, the local context buffer is also updated accordingly. 
[01 02J In one embodiment of the invention where Italian is addressed, the apostrophe character, and similar char- 
acters that may be present on a keyboard or character set, as well as all accented vowels, are utilized as activator event 

55 sequences since 11 has been determined that utilization such activator events provides a method for providing correctly 
accented and punctuated words In a manner that Is intuitive to a user of the Italian language, in utilizing the apostrophe 
character, system 100 avoids interpretation errors by system 100 without requiring a lager sized dictionary. System 100 
processes Italian end-of-word conditions such as accent, apostrophe, and no sign, using general suffix rules, which are 
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capable of being Implemented In using a limited word dictionary or even no word dictionary Regardless of the size of 
the word dictionary utilized by system 100, the user may enter a new word, or may start writing in another language, or 
may write an Italian word that may exist both with and without a sign on or after the last vowei. In such cases, system 
1 00 estimates the most likely Intention of the user for pressing the apostrophe key. If system 1 00 finds no specific likely 

5 reason for the apostrophe, other than It being part at the word, then the word suffix rules are applied, otherwise the 
apostrophe is left as is, and is not treated as an activator event For these reasons, In one embodiment a list of the most 
frequent words with an apostrophe or accent is provided, as well as words which commonly are mistakenly written with 
such asign. regardless of whethar system 100 has asuffix rule that already would produce accurate resuft for this word. 
For example, a suffix rule saying that the sign normally used on words -che", i.e., all words ending wtth "che", Is an 

w acute accent as in "perche", would work very well If the user wrote: 

perche' 

at the beginning of a sentence. The word is automatically converted to: 

15 

perche 

Where system 100 encountered" 
20 'perche' 

system 100 determines to convert the input to: 
'perche 

25 

if the complete word "perche'* was found in the dictionary, and the data in the dictionary made it clear that the word only 
existed with an acute accent If the word was unknown, or was such that it could be written both with and without accent, 
usually Indicating two different meanings, then system 100 leaves the apostrophe unmodified, assuming it was a dos- 
ing single quote. Different default behaviors for system 100 are optionally set 
30 [0103] in the previous example, I.e., in a system containing an exact word entry for ''perche" when the user presses 
the apostrophe activator event for the second time, system 1 00 produces: 

.'perche' 

35 such that system 1 00 recognizes both the pending closing single quote condition, and the accented word, the IME loop 
places the vowel + acute accent + apostrophe combination in a second position after the first press of the apostrophe, 
resulting in vowel + acute accent, resulting in an Intuitive and efficient input sequence for this particular context. 
[0104] In one embodiment of the invention, two major aspects differentiate the default behavior of system 1 00 when 
applied in an interactive context such as keyboard input, compared to a non-interactive stream such as file or clipboard 

40 data: 

1 . Accents Inside words are not corrected in non-interactive mode; 

2. Repeated activator events e.g., apostrophe characters, do not initiate IME loops in non-interactive modes. 

45 In an alternative embodiment of system 100, three aspects differentiate the default behavior of system 100 when 
applied In an interactive context such as keyboard input as compared to a non-interactive stream, such as file or clip- 
board data: 

1 . Accents inside words are not corrected In non -interactive mode; 
so 2. Repeated activator events (e.g. apostrophe characters) do not initiate IME loops in non-interactive modes; 

3. Spacing characters are not automatically inserted as part of the automatic processing of accent and apostrophe 
characters in non-interactive mode. 

The differences describe the additional control provided by interactive mode, which is typically not available when work- 
55 ing on a non-interactive input stream, although the additional control may be optionally utilized in a non -interactive mode 
If desired. For example, rf the present system were applied with the purpose of converting 8-bit Italian text data to 7-bit 
data such as a plain ASCII character set, apostrophe characters, which are part of the ASCII set, could be used in the 
text in place of accents, which are generally not part of the ASCII set. This results a text with simple apostrophe char- 
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actars Instead of more complex control sequences, that are readable by humans, and which could be processed by sys- 
tem 100 for reconversion to 8-btt data In some instances, where during conversion to 7-bit data system 100 detects 
that the output of a single apostrophe character would be such that re-converston to 8-bit data would produce a result 
different from the original, system 100 outputs multiple apostrophe characters, In which case functionality comparable 

5 to interactive 1ME loops is provided In non-Interactive contexts. 

[0105] System 1 00 provides an option to Indicate whether accents should be placed on upper case letters. In one 
embodiment, the default for Italian is Yes. If the setting were No, as with some languages such as French and for certain 
editorial styles, one setting provides all upper case letters with no sign, regardless of their position in the word. In one 
embodiment system 100 remove accent signs and appends an apostrophe to the end of the word if an accent was 

w removed from the last vowel of the word. System 100 provides a similar option to indicate whether accents should be 
placed on a lower case letter. An application of this option is, when set to No in combination with the option to not place 
accents on upper case letters, to create a pure 7-blt text System 1 00 also provides settings to change the apostrophe 
character which Is appended at the end of words when an accent was removed as a result of a setting incflcating not to 
place accents on upper or lower case letters. By default in one embodiment, the apostrophe character Is used, but dff- 

is ferent characters are optionally used, for example the grave and the acute accent character, depending on whether the 
accent removed from the vowel at the end of the word was grave or acute. 

[0106} An additional option of system 1 00 determines whether foreign words appearing in the word fists (ITALIAN- 
IZED flag) should be left as written, or replaced with the original non-Italian word. The default setting in one embodiment 
is to leave the words as written. An other option of system 1 00 is replacement rules for words with a COM PLEX=<strino> 

20 attribute, where any matching word would be replaced with the (string) (e.g., -Cezanne" would become -Cezanne"). This 
option is enabled by default In one embodiment, and is helpful to properly write certain non-Italian words, usually French 
words used in Italian. Yet another option of system 100 determines whether end-of-word accents or apostrophe char- 
acters may be automatically added to words even if the input stream contained no sign at all. This option is disabled by 
default, as already explained. One possfole setting is to enable this option only for weekdays (WEEKDAY flag) or for 

25 words with the TRICKYCOM POUND attribute. Another setting enables the option for all words which have no NOTH- 
ING flag, and only one of GRAVE, ACUTE, CIRCUMFLEX or APOSTROPHE. 

[01071 Another option allows the user set the level of verboseness during interactive mode, i.e., the frequency at 
which tool tips are opened above the cursor to display Information. The default setting In one embodiment is to display 
Information relating to words which may be written with more than one sign, e.g., with an apostrophe, or with an accent, 
30 or with no sign, and which have different meanings depending on the sign that the user may decide to use. Tool tips are 
also displayed by default in one embodiment when an IME loop Is in progress. 

[0108] An option of system 1 00 allows for the normalization of the apostrophe character, i.e., if the input contains a 
character that is similar, but not Identical, to the apostrophe character, then the input character is processed as a user- 
desired standard apostrophe character For example, many keyboards contain a grave character, which is often used 

as instead of the apostrophe, to which it is visually very similar, and possibly resulting in inconsistent use in the text This 
option ensures thai the text contains the same apostrophe character. An additional program option is associated to the 
spacing apostrophe as described herein. In one embodiment, apostrophe characters as well as similar equivalent char- 
acters are Interpreted as opening single-quotes If they are Immediately followed by a letter or digit, and not Immediately 
preceded by a letter or digit. Similarly, in order to be recognized as such, closing quotes must be immediately preceded 

40 by a letter, digit or punctuation sign, and not be followed by a letter or digit. Quote characters followed by POSTAPOS- 
TROPHE strings, or by two digits (as in the summer of '99"), do not count as either opening or closing quotes. Other 
techniques to recognize opening and closing quotes are utilized, for example simply requiring a single opening quote 
characterto be preceded by a space, new line or beginning of text, and treating every other quote as a closing quote. 
All of these techniques are optionally used. Double single opening and closing quotes are recognized in a similar way, 

45 For certain languages, it may be necessary to treat single or double-comma characters, Immediately followed by a letter 
or digit and not Immediately preceded by a letter or digit as if they were quote characters used as opening quotes as 
in This is an .example" used in German*. After a single or double opening quote has been identified, system 1 00 sets 
a corresponding flag that is cleared only after a corresponding closing single or double quote. In order to avoid leaving 
the flag set by mistake, e.g., after a single quote that had incorrectly been identified as an opening quote, the flag is 

so cleared after a certain number of characters, words or sentences. Optionally, system 100 contains a table indicating, for 
varying character, word or sentence distances from an opening single or double-single quote recognized with a certain 
technique, the statistical likelihood, based on previously analyzed real-text data, that a closing Item appear in that rela- 
tive position, for example, after 100 characters from an opening quote, the likelihood that the following character is a 
closing quote is determined to be 1.31%. If necessary, this data is compared with a threshold below which the single 

55 quote mode llag is cleared, or the data is compared with statistical data about the likelihood of an apostrophe character 
after an unknown word being an apostrophe or accent or being unrelated to the word. In certain environments, such 
as for example those requiring higher editorial standards, various contexts in which single quotes are encountered 
could be flagged as warnings for user inspection without relying on automatic processing. 
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[01091 Optionally, system 100 issues a warning whenever the single quote mode flag is automatically cleared 
because the distance trom the opening quote is determined to be excessive, or because the end of the text is reached. 
Also, a warning is issued if an opening single quote is encountered within a context, which already is In single quote 
mode, If a quote-depth-counter Is used Instead of a simple flag, a warning Is Issued ft, at the end of a document, or after 
£ a certain distance from the last opening quote, the numbers of opening and closing quotes do not match. 

Interactive Mode: Desired IME Loops for Italian 

[01101 The action wherein system 100, based on a sequence of input events, produces different text outputs, one 
w replacing the other, Is herein referred to as an Input Method Editor (IME) loop. The contents and arrangement of the 
possible outputs, through which system 1 00 loops, can change depending on the application, for example wilting ol Ital- 
ian or another language, or the Input of currency symbols, etc., user settings, and data collected during previous IME 
loops. For IteJan, in one embodiment the purpose of the default IME loops is to allow the user to cycle through an the 
possible accent and apostrophe combinations. Tnis includes all possible accents, the apostrophe, and the letter without 
is sign. The user is also allowed to write an accented letter followed by an apostrophe or single quote. For this reason this 
combination of characters is also optionally part of the IME loop. Different variants are possible: the IME loop tor each 
vowel for example in one embodiment includes all combinations of accents followed by an apostrophe, or the correct 
accent as determined by the rules, followed by the apostrophe. In one embodiment, balancing these two considera- 
tions, the IME loop contains the second case because it is less likely that the user writes a word on which system 100 
a? would place an Incorrect Bccent, and that the same word also is followed by a single quote or apostrophe. Even such 
an unusual input can be processed by system 1 00. Typically, in one embodiment IME loops are used in interactive mode 
i.e., during keyboard input, rather than In file and clipboard operations. 

(0111] in general, in one embodiment an IME loop for Italian Is initiated and used with the same keyboard key that 
also serves as an activator event for the automatic placement of the correct sign at the end of Italian words. In one 

25 embodiment the activator event is the apostrophe key, or the grave key, or any accented letter key. When an apostrophe 
or grave key is pressed once after a letter, or when an accented vowel key is pressed, system 100 parses through the 
rules and outputs the character or character combination determined to be correct, for example a letter with no sign, a 
letter followed by an apostrophe, or a vowel with an accent, or a letter followed by a space. Thus, the first output Is likely 
and nominally a more correct output The IME loop allows for a different output selectable by the user in an Intuitive 

so manner, which in one embodiment occurs by pressing or actuation of the activator event, accented vowel, or apostro- 
phe, or acute, again and In succession. In one embodiment, settings and implementation options limit both the possible 
key or keys that are recognized as activator events, for example to use accented letters for manual input, and the apos- 
trophe for automatic input, as well the keys that can activate an IME loop, If at all. 

[0112] An additional option provided by system 100 determines the behavior when different activator events are 
35 enabled, arid when such different keys are pressed one after the other. For example, when the user enters the following 
8 keys: 

P-e-r-c-h-e-e-' 

4o the above can be considered an IME loop, equivalent with: 
P-e-r-c-h-e 

and 

45 

P-e-r-c-h-e-e-e* 

[0113] In one embodiment, a default implementation for the input of Italian text, an IME loop is only initiated when 
the same key is pressed more than once, providing a more rigid and predictable system for the user, leaving out the 

so different sequences for the manual handling of exceptions. Different options of system 100 may account for different 
behaviors if desired. Also, if the above first example is set not to initiate an IME loop, each of the last three characters 
can be considered an activator event, causing system 100 to apply its usual rules to each character. In one embodi- 
ment, this is the case. In one particular embodiment, if the activator event is an apostrophe, the previous context letter 
is considered as if it were written without any accents, i.e., the apostrophe when pressed for the first time causes the 

55 correct sign, accent or apostrophe or space character or no sign, to be placed by system 100. This also applies to the 
case in which the user moves the cursor immediately after an existing word in a document, rather than writing the word 
or part thereof, and then presses the apostrophe key or the acute key depending on what activator event is enabled. 
Thus, in one embodiment if the user moves the cursor immediately after a word that already has the correct accent on 



27 



EP 1093 058 A1 

the last letter, and presses the apostrophe key, then to the user that Input has no effect, other than confirming that the 
existing text Is already correct Successive, repeated input of the same apostrophe key would initiate an IME loop. A 
different Implementation or option allows the IME loop to work In such a way that when the user writes multiple but dif- 
ferent activator events one after the other, these ail contribute to the activation of the same IME loop. 
5 [01 1 4] Another Implementation or program option coutd affect system 1 00 behavior In such a way that If the epos- 
trophe or acute character, or any other character considered similar, Is pressed after an accented letter, then that letter 
is not considered without accent, as in one embodiment, but rather, an IME loop is immediately Initiated, causing the 
apostrophe to change the accent to the next step In the IME loop, rather than starting from the rule placing the correct 
sign. 

10 (01 1 5} In one embodiment the rule for the user is predictable, for example the first press of an activator event results 
in a correct sign. In a particular embodiment, the second press, which initiates the IME loop, produces a character that 
is always the same, and in an alternative embodiment where a single closing quote Is expected It places the accent fol- 
lowed by the apostrophe in the immediately next position of the loop. Also, if the user repeatedly, or even Just once, used 
the IME loop functionality to change a sign after a certain word, in one embodiment system 100 remembers this and 

15 automatically adds an appropriate entry to Its rules, or alternatively displays a message, either instantly or when the 
user asks to view a list of words that were manually changed, proposing to do so such that that when the user again 
writes the same word, the chosen sign is produced as a first result Aiso, the order In which different accented charac- 
ters appear in the IME loop is optionally the same for each letter, and alternatively the flags that Indicate the possible 
accents or apostrophe combinations for that word are considered In order to place the known possibilities for that word 

20 first in the list All of these variants are optionally implemented by system 1 00. 

[0116] In one embodiment the IME loop begins after an activator event is pressed for the second time In a row. A 
first time, system 1 00 considers its rules to place the correct sign. The second and following times, other characters are 
produced, and when all the steps of the cycle have been exhausted, the loop begins again as if the key were pressed 
for the first time. When the key Is pressed for the second time, a tool tip or small Information window appears over the 

25 cursor position, with a message such as 'Press again for: {choice 1), (choice 2). . . . (choice n>", Indicating the order in 
which the following characters would appear, with the next IME step due appearing first For example, after the user 
writes "perche" using the apostrophe after the V to produce the last accented letter, and then presses the apostrophe 
for a second time, the word is changed to "perche", and the tool tip says "Press again for: e 6' e' e e". If the user chooses 
to display the tooJ tips, and not only in cases such as when the IME loop was actually used as a result of repeated press- 

30 Ing of the activator event, then the tool tip would have been displayed immediately at the first press of the apostrophe 
key after *perche", which resulted In -perche"): "Press again for: e e e' e' e\ 

[0117] Very different possibilities exist forthe exact implementation of the IME sequence. In one embodiment stable 
predictability is optimized with consideration for a sequence that when applied to vowels results in a predetermined 
order, in the vowel with grave accent, acute accent, circumflex accent, the Initial correct accent followed by an apostro- 

35 phe intended as a possible closing quote, and the vowel without accent followed by an apostrophe. For words that are 
known to exist with a final apostrophe Indicated with the APOSTROPHE flag in the rules, after the grave, acute and cir- 
cumflex steps, the IME loop additionally includes the vowel followed by two apostrophe characters, one as part of the 
word, and one as a possible closing quote. For consonants aner which system 100 automatically removes the apostro- 
phe, e.g., after "quaC, the loop consists of two steps, i.e., the letter followed by an apostrophe, and the letter followed 

ao by a space character. The sequences described herein in one embodiment begins with the correct sign, which Is placed 
automatically by system 1 00 when the user presses the activator event for the first time. After the other options are out- 
put as part of the loop, the loop continues again with the correct output, etc. When the first output causes the removal 
of an apostrophe, then the letter followed by the apostrophe appears in following position in the IME loop. 
[0118] Examples of IME loops where the first output is rule-based, i.e., correct, and in this example is activated with 

as a first press of the apostrophe key; last output is identical with first, and indicates where the loop begins again, include: 

perche + » = perche -> perche ~» perch e ^ perche' -* perche' -> [repeat from "perche") 
e + 'se-^e^e-^e' -» e* [repeat from "e"J • 
po + ' - po' p6 po -» po -» po" — > [repeat from *po"] 
so omicidi + ' = omteidi omicidl -> omicidl omiciaT -> omickH' -> [repeat from "omicidr] 
qual + * ss qual + SPACE -> qual' -> [repeat from "qual+SPAClT) 
qui + ' = quijapostrophe removed] ~* qui' qui qui -> qui f repeat from 'qui"] 

For upper case letters the output is identical, but in upper case, 
ss [0119] If the activator event is an accented letterinstead of, for example, an apostrophe, the output is slightly differ- 
ent because the steps of the IME loop do not Include entries with an apostrophe in such an embodiment unless the 
rules for the current word indicate that the word is known to system 1 00 to exist with an apostrophe. There are no ambi- 
guities about possible closing quotes and other non-word apostrophe characters as such characters would be entered 
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using the apostrophe key rather than using an accented letter. If the initial automatic change of system 1 00 transforms 
the accented letter to a letter foDowed by an apostrophe, or to the letter without any sign at all, then that Initial correct 
output is at the end, a new beginning of the IME loop. For example: 

5 . perch + e = perch 6 -» perche ~* perche -» [repeat from *perch6"] 
e = e->4-»e-> [repeat from *e°l 
p + o = po' -> p6 -> po -f p6 -> [repeat from "po"] 
omlcid + ) = omlcid! -> omlcldl -> omlcidf -» [repeat from "omldoT] 
qu + \ = qui[accent removed] -> qui -> quf -> qui [repeat from "quf] 

JO 

[0120] If the activator event is a repeated unaccented vowel Instead of an apostrophe or an accented letter, the out- 
put is slightly different, and based on the rules for the currant word, the IME loop begins either with a double vowel if the 
word is known to exist with a final double vowel, or with an appropriate accent or apostrophe. For example: 

is perche + e = perch& -> perchn -> perchA -> perchee [repeat from perche] 
po + o = po' -» pp p a P-L -> poo -» [repeat from po'] 
zl + J = zii -> z£ -» zP zT z1' -> [repeat from zll] 
qui + 1 = qul[no accent] quH -> quP -> quT -> qufl -> [repeat from qui] 

20 [0121] Different Implementations of system 100 are capable of providing different sequences, for example allowing 
for all the possible combinations of accents followed by the apostrophe, rather than onfy the correct accent. Alterna- 
tively, system 100 is designed to include a subset of a given Implementation considering that in Italian the circumflex 
accent is generally used only on the letter I, and the acute accent is generally only used with E and 0. The implemen- 
tation described herein accommodates the input of foreign words, for example non-Italian words, resulting In loops that 

25 are identical apart from the Initial output which is context-based, and therefore more predictable, which is a more Intui- 
tive system for the user regardless of the letter. 

[0122] Another possible implementation of system 1 00 considers the ACUTE, GRAVE, CI RCUMFLEX and APOS- 
TROPHE flags associated with the rules entry that produced a match for the current word. Depending on the flag, the 
combinations that had no matching flag are excluded from the IME loop, or alternatively appear at the end. Another 
30 embodiment of system 1 00 takes into consideration whether the current word is written in a context where a closing sin- 
gle or double-single quote is expected, and adds these options to the loop, optionally to the beginning of the loop in the 
event the activator event was the apostrophe. 

[0123] An alternative embodiment of system 100 is substantially similar to the current Implementation of the 
present invention except that if the activator event is the apostrophe and the rules for the current word confirm that the 

35 word is certainly written with a certain accent or apostrophe with no ambiguity or the possibility for the word to be written 
without sign, and the context is such that a single closing quote is expected, then a first press of the apostrophe pro- 
duces the correct sign after the word, and the second press adds the closing quote. Similarly, in a context where double- 
single quotes are used instead of single quotes, a third press adds the second closing quote. Afterwards, the IME loop 
continues with the other signs. Another alternative embodiment learns from previous user choices, and proposes an 

40 IME loop where the most frequent previous choices appear first The data is associated to individual words, or grouped 
by letter (A, E, 1, O, U, consonants). Another alternative embodiment considers the final selection resulting from the use 
. of the IME loop, and adds an appropriate entry in the rules, so that a following time the word Is written with the same 
activator event, or optionally even with another activator event, the first output without even waiting for the IME loop is 
the one previously chosen through the IME loop. Different variations or program settings make it possible to make the 

45 . record temporary or permanent, and automatic or based on user action. An additional alterative embodiment allows for 
the new rule to be automatically recorded for a word after the user wrote a word in a certain way thereby overriding the 
initial default output of system 1 00 for a certain number of times, and optionally without ever accepting the default output 
for that word. In a further alternative embodiment, a POSTAPOSTROP HE condition retroactively overrides b previous 
automatic conversion of an apostrophe to an accent, or the removal of an apostrophe, even as part of an IME loop, for 

so exampled where the user is trying to write "Jos6's car is red"). This is because a POSTAPOSTROPHE condition typi- 
cally indicates a non-Italian context In which an Italian word or suffix rule is applied by mistake, or in which an IME loop 
Is initiated by mistake. The above alternative embodiment is optionally extended to activate a re-correction or further 
modification after a POSTAPOSTROPHE string, and also in general whenever the activator event is followed by a letter 
thereby placing the previous output in the middle of a word rather than at the end of it. This useful for example for tan- 

55 guages where it is of advantage to give priority to correct an unmodified input of the apostrophe sign. 
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Additional Considerations for Italian 

[0124] The addition of letting system 1 00 add spacing as appropriate brings allows the use of an activator event or 
character to be similar to or equivalent to a single key press. The particular procedure Is applied for automatically irtsert- 
,s )ng a space but without the requiring applying logic to place the correct accent or apostrophe. As a result, system 100 
provides a reduction of key presses compared to traditional input The following are examples thereof: 

Example - Traditional input Uelba e bella (14 key presses, requires appropriate keyboard end writing knowledge) 
Example - Intermediate system: Lafoa e' bella (15 key presses, easy Input) 
10 Example ■ Extended system: Uaba e'bella ( 1 4 key presses, easy input) 

Example - Possible option/variant to 3.: L'alba ebella (13 key presses, easy input using both apostrophe and any 
accented key, which is automatically corrected If necessary) 

Example - Possible variant of 1.: L'alba ebella (13 key presses, requires appropriate keyboard and writing knowl- 
edge) 

75 In all cases the output would be Ualba e bella 

[0125J An extended system ernboolment accepts the Input of a space key after the apostrophe. When the space 
key Is pressed, or if the vowel-apostrophe combination is followed by a punctuation character, no space Is Inserted. The 
automatic space insertion occurs or is confirmed if the apostrophe is followed by a letter, number or graphical sign that 

20 If It occurred alone as part of a sentence would require a space character before it. 

101261 For certain characters which normally occur in pairs, such as parentheses, brackets, single quotes, double 
quotes and other characters, no space character is normally placed before the closing Item. When these characters are 
graphically d ifferent, such as is the case for the Tarri T parentheses, system 100 determines whether they require a 
space before them or not in the event that they appear after an apostrophe input that is processed in such a way as to 

25 possibly require the automatic Insertion of a space character. Some characters can also be written as graphically iden- 
tical signs, and based on the context they are Interpreted either as opening or as closing items. These characters 
include the double quote and the simple quote character, which in general is the same character as the apostrophe. For 
. example, the user writes: 

X o"p . . . 

In the above case, system 100 adds a space after the accented letter if the quote character is an opening quote. If the 
type of the quote character whether It is an opening or closing quote is Itself determined by the presence of a space or 
a letter before it, then no result is determined and the context remains ambiguous. System 100 therefore keeps track or 

35 opening and closing double quotes as system 100 already does for single quotes, or alternatively in such a case the 
automatic insertion of the space character is deterred until the user enters an additional character after the quote char- 
acter. In such an embodiment, the type of quote is determined not by the characters before it but by the text following 
It. A closing double quote is typically not immediately followed by a letter or number, but Instead Is followed by a spacing 
or punctuation sign. By applying such a detection rule or an equivalent one, the type of double quote is determined, and 

40 If the quote is identified as an opening double quote, a space is retroactively inserted between the accented character 
or character with apostrophe and the opening double quote. 

£0127] The specific output of different combinations of an accented vowel followed by a closing single quote, or of 
a vowel followed by an apostrophe followed by an identical sign which Is a closing quote, or of an unaccented vowel 
followed by a closing quote, which are rare but exist, are an possible with system 100 described herein by repeated 
45 pressing of the apostrophe key until the desired combination is output such as with an IME loop which includes not only 
accent variations but also accent and apostrophe combinations. 

[0128] in French and according to some editorial guidelines, the set of characters that are preceded^by a space 
includes punctuation signs which are composed of more than, one graphical mark such as *?", T, V and V . In Italian 
these punctuation signs normally have no space before them. In one particular embodiment of system 100, the space 

so character is not automatically inserted immediately after the apostrophe is processed but after the character after the 
apostrophe is input by the user. In the event where system 1 00 produces incorrect output which results either in a miss- 
ing space character or in an undesired space character, the user can go back one character using the backspace or 
cursor left key for example, and respectively either add a space or continue writing. Such an embodiment of system 100 
includes the option not to re-correct or to further modify, or to alternately re-correct or further modify after the user over- 

55 rides an eutomatic correction. 

Sample input: la liberta'^'perche*) 
Resulting output la liberta (e perche) 



30 



EP 1 093 058 A1 



(Spaces automatically added before words and other non-punctuation signs) 

Sample input la Itoerta*; e"perche ,# 
Resulting output la liberta; e *perche" 

5 

(No space automatically added between apostrophe and punctuation or closing quote, but added before opening quote) 
[0129] In some embocfiments of system 1 00, there are special cases in which even in an Italian context the apos- 
trophe sign after a vowel is not immediately followed by a space but by a letter, This is the case for example with English 
possessives and other patterns e.g., I'd try" which in an Italian context are usually related to either English or German, 
w and are solved with appropriate POSTAPOSTROPHE entries. Thus, the additional step described above, like other 
parts of system 100, optionally removes any space characters ft automatically added if they are followed by a POSTA- 
POSTROPHE string. 

Sample Implementation: Processing of German Text Input 

75 

[0130] German uses the special characters -ft'. -0", TT in lower case, and "A*, m & i *Q* in upper case ("B" 
becomes *SS" in upper case). This is a total of 7 special characters compared to basic Italian's 12 characters. The sign 
on top of the vowels Is called an umlaut Where these characters are not available on the keyboard, character set or 
output system, the traditional replacements are •ae", *oe", *ue* and •ss", respectively. In rare cases, for example Internet 
so web and email addresses, ft has become accepted use to also use "a", V, V Instead of 'a", T, "0" In both lower and 
uppercase. The special characters used in German are associated with needs that In the case of text input are In part 
similar to Italian. Unlike Italian, however, these characters appear more frequently, appear in the mWdle of words, and 
are more difficult to be determined. System 100 accommodates inputting these characters when they are not present 
on the keyboard. 

25 [0131] System 1 00 utilizes different optional ways to enter the special characters for German. In one embodiment 
a keyboard hook function is utilized that intercepts the combinations of Alt + a, Alt + o, Alt + u, Alt + A, Alt + O, Alt + U, 
Alt + s and Alt + S. and changes the output to a, 6, 0, A, 6, 0, 8, SS. The activator event Is set to Alt by default in one 
embodiment but could be changed In other embodiments. Alternatively, input of German characters is possible through 
IME loops. E after A, O or U results in the output to be changed to A, 0, 0. When E is pressed egain, the less frequent 

3o AE, OE, UE pairs are produced. When E is pressed again, the very rare AE, OE, UE pairs as in "Europaer and •BBe" 
are generated. If E is pressed again, the loop begins again from A. 6, 0. This applies both to upper and to lower case. 
If the case of E Is different than that of the first letter, the case of the first tetter is the one that is applied to the output 
making it easier to write Initials with umlauts. Options for different behavior are provided. 

[0132] In lower case only, an IME loop that produces B and other character combinations is activated by repeated 
35 presses of the "s" key, as follows: s, ss, B, Gs, sss. When the V key is pressed a sixth time, the loop starts again from 
the simple V, and so on. The order of the steps in this loop is based on frequency. Especially after the writing reform 
fRechtschreibreform") approved in 1996, % ss* is more frequent than U". Both "fls" (as in •GroSschreibung-) and "see* 
(as In "Russsand*) are rare, but posstole. The default Initial output of system 1 00 is optionally made dynamic based on 
rules as with Italian. For example, system 100 automatically converts AE, OE and UE pairs to the respective vowel with 
40 an umlaut, as appropriate. 

Sample Implementation: Processing of Spanish Text Input 

[0133] Spanish uses the special characters A, £ , i, 6, 0, U, N, both in lower and in upper case appearing anywhere 
45 in the word as well as the special punctuation signs V and m \\ The apostrophe character is used for single quotes and 
non-Spanish patterns such as POSTAPOSTROPHE. Thus system 1 00 can be adapted to a system similar to an Italian 
embodiment where the rules for each vowel consist of simple fallback rules with an ACUTE flag so that after the apos- 
trophe is pressed following a vowel, the result is the vowel with an acute accent. For consistency, the apostrophe is also 
be used to place the tilde on top of the N. The IME loop for the vowels toggles between all possible signs, as for Italian, 
so or alternatively between the acute accent, the umlaut optionally for the letter U and the vowel followed by an apostrophe. 
For the N, the IME loop toggles between the N with tilde and the N followed by an apostrophe. The special signs V 
and Y are generated via an IME loop that produces the special character when T or T t respectively, are pressed an 
even number of times. Such an embodiment simplifies the writing of Spanish using a non-Spanish keyboard where cur- 
rently different combinations of Ctrl, Alt, Shift, Alt *- digits or other difficult to enter and to remember keyboard 
55 sequences are used depending on operating system 128 and application 130. When people write with a pen the sign 
is placed after writing the vowel and not before. As with Italian, system 100 described makes the input of Spanish intu- 
itive for keyboard input on a keyboard without the Spanish characters. 
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Sample Implementation: Processing of International Text input 

[0134] In one embodiment IME loops are used to generate all variations of a certain character when that character 
is input a certain number of times, for example pressing a certain key two, three times or more to initiate the output of 
s special characters rather than the same letter repeated two, three or more times. In an alternative embodiment, system 
100 initiates an IME loop when a certain character is pressed in combination with a qualifier key such as Alt. For exam- 
ple, repeated presses of Alt + A produce all the variants of A with various diacritical signs. 

[0135] In one particular embodiment a simpler approach of system 100 is provided by combining the loops for Ital- 
ian with a combination of Alt + letter filters which for example produce *fi* when Art + n Is pressed (Spanish character), 

to "G" when Ah + s Is pressed (German character), V Alt 4- c is pressed (French character), etc., and optionally 
inserting the vowel + umlaut (German character) step in the IME loops tor Italian. For languages such as Greek where 
certain letters may have different shapes depending on the position in the word for example slgma at the end of word 
or beta at the beginning of a word, system 100 places differently shaped characters based on the context. At the begin- 
ning and in the middle of words this is done immediately, whereas conditions requiring different handling at the end of 

15 a word are processed retroactively, as soon as a non-word character is entered. Each time characters are removed or 
added from or to the beginning or and of a word, the procedure dynamically applies the required changes In order to 
keep the Initial beta or the ending sigma correct 

Sample Implementation: Input of Currency Symbols 

20 

[0136J In one embodiment of the Invention, system 1 00 includes an option to place the Euro sign in a first or second 
position based on user choice in the IME loop associated to keys such as $ or £ For example, pressing the dollar key 
once produces the dollar sign, and twice it produces a Euro sign, or vice-versa. More complex loops generating a wider 
variety of currency symbols are associated either to an existing currency key or to an otherwise unused key such as the 

25 backslash (A"). As considered for the input of Italian, the order In which the currency signs appear In the IME loop Is 
changed dynamically in one embodiment System 1 00 automatically outputs the most frequently-used currency symbol 
when a certain key Is pressed the first time, and then in order of frequency of use produce IME steps when the key Is 
pressed again. Alternatively system 100 maintains the first character output constant, for example to be Identical with 
the character normally associated to the keyboard key, and to affect the output of the followingcharacters such as when 

30 that key is pressed more than once. The dynamics by which the order of the IME steps changes is controlled by param- 
eters indicating, for example by how much, percentage or absolute value, a certain key becomes more frequent than 
another one before it takes its position in the loop, and whether a change in order requires a certain number of consec- 
utive hits by a character before it Is considered for a higher position In the IME loop. 

35 Additional Options and Variations 

[0137] Considering that system 100 determines the relationship between 7-bit input characters and their accented 
forms, and converts between the two by applying different techniques and considerations, an optional Implementation 
of system 100 is where system 100 is directly interfaced with contexts where the user enters an Internet Uniform 

ao Resource Locator (URL) commonly referred to as an Internet address, and by determining which characters are 
acceptable In the URL string, It converts Illegal or prohibited signs to legal signs by applying different variations If more 
than one acceptable variation exists. For example, Internet World Wide Web addresses can be recognized because 
they begin with prefixes like "httpyr or "https://". In the domain and host names which make up such web addresses, it 
is currently not allowed to include any character otherthan letters from A to Z without accents, digits and the minus sign 

45 (hyphen). If the user, remembering a company name such as "Muller", entered a web address of "www. mailer.com*, the 
browser only attempts to connect to the server with the name exactly as typed, which results In a failure or error 
because such a domain registration Is not even possible. System 1 00 as described here may first attempt to connect to 
www.mQller.de, but if that failed, system 100 in turn attempts to connect to www.mueller.de, or www.mulier.de, or both, 
In a desired order until a connection succeeds. If the domain or host names contained more than one special character, 

so they are in a similar fashion converted to characters that are acceptable for the type of URL being entered, first attempt- 
ing expansion, and optionally stripping of accents, and then optionally combinations thereof). Similarly for the special 
signs of Italian, the accents are removed without replacing them with apostrophe signs and also removing any existing 
apostrophe signs that may have been entered. The same occurs for the special signs of French and Spanish, leaving 
plain letters A to Z. Any syntax that at the time of coding of system 1 00 is known to be invalid is optionally still attempted, 

55 either as a first try, or as a last attempt, with consideration to the fact that it is likely that special characters will in the 
future become acceptable even In domain and host names. 

[0138] As forthe activator events for Italian and other comparable languages, instead of or in addition to the already 
mentioned accented vowels, and the apostrophe and similar keys, the activator event may include the repeated press 
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of a vowel key since vowels almost never appear more than once In a row in Italian, or the action of holtf ng a key 
pressed for longer than a certain predefined amount of time. For example, entering •perchee", or entering •perche" and 
holding down the last key a little bit longer than usual automatically resufts In "perched Pressing "e" again or holding It 
down even longer Initiates an (ME loop thereby proposing further possible signs. A similar technique Is applied to spe- 

5 cial signs such as opening and closing double quotes. For example, system 100 associates an IME loop to the double- 
quote character with the first press generating a pialn double quote, and repeated presses producing either opening 
and closing double quotes In a predictable constant order, or with the entire order based on frequency and context con- 
siderations. Alternatively, IME loop functionality is implemented in such a way such that the first Input of the double- 
quote character Is nominally automatically changed to the correct opening or closing double quote, but subsequent 

10 repeated presses restore the original manual input or loop through the other possible related characters. 

[0139] The embodiment of system 100 providing the option of simply holding a key pressed is applicable to ail 
embodiments including to all cases where activator events as well as the repeated Input of a certain character are uti- 
lized for activating a certain event such as a correction, a re-oorrectlon, or further modification, or the Initiation or next 
step of an IME loop. Such an action of holding down a key for a predetermined duration optionally provides a special 

is meaning for some characters and contexts depending on the Implementation, and can still be considered as a more tra- 
ditional auto repeat for other keys or contexts. As for the meanings that can be associated to certain Input patterns, 
Including holding a key down, repeated press of the same key, with or without consideration to context, system 100 con- 
siders and applies an activator event for example to place an Italian sign, overriding a previous automatic correction, 
initiation or continuation of an IME loop, and requests to display some type of information, for example linguistic help. 

20 These are optionally implemented In any combination. 

[0 140] System 1 00 optionally includes a number of options to temporarily disable all or part of its actions. This may 
be done for example by assigning a certain key or sequence of keys to the temporary turning off of system 1 00 which 
In one embodiment is limited to the next character, or to all characters until the same certain key or sequence of keys, 
or another key or sequence of keys is Input meaning that system too continues operation. Certain keys which on most 

25 keyboards have a status Indicator light such as Scroll Lock can also be used, in which case the light becomes a useful 
indicator of system status. Another option to disable system 100 and allow for unmodified input in one embodiment Is 
to consider certain qualifier keys which when held down during input of other text cause system 100 not to take any 
action. Another additional option to allow lor unmodified input is to not take any action ff the user explicitly resorted to 
an Alt + (0) + number combination, or another keyboard sequence which by default is used on system 100 to input cer- 

30 tain characters even rf they are not present on the keyboard. 

[0141 ] The actions that cause certain events to occur in system 1 00 are based in one ernbocfiment on the analysis 
of context, for example consideration to pending single quotes, or in German the repeated press of u e" after *a B , etc., 
and linguistic and ttterary factors such as the likelihood that certain text patterns, for example double or triple vowels, 
quotes, or currency symbol, appear as part of the traditional text flow or not System 1 00 uses certain characters both 

35 in a normal and in a special In a particular embodiment of system 100. a default implementation applied to Italian con- 
sists of the same set of activator events serving dual purposes of allowing for the input of special characters and also 
of correcting certain common accent and apostrophe errors. 

[0142] One embodiment to handle unknown words tor languages such as Italian where accent rules have a strong 
focus on the word suffix Is where system 100 considers the best accent for an unknown word based on the longest 

40 matching suffix of other word entries and optionally suffix entries in the list of rules. As the number of entries in the rules 
increases, such an embodiment produces better results when applied to unknown words than the fallback rule and In 
some cases even suffix rules. Furthermore, as an additional option in a case where a previous check does not produce 
any matches, for the purpose of matching the suffix of the unknown word with the suffix of existing entries, system 1 00, 
with exception to the last vowel, considers certain sets of letters to be identical, that is to count as a match. For example, 

45 all vowels are considered as a universal vowel matching character, so that "ahime" matches "ohime". To further deal 
with unknown words an optimal manner, system 100 provides different options to extend Its dictionary of rules. One 
embodiment of system 1 00 provides for the rules to be updated from the Internet by loading a new set of published rules 
and through the user interface where the user may add, edit or remove individual rule entries. Optionally, system 100 
either automatically adds to the rules, or modifies a rule entry if rt exists in a different format, instances where the user 

so changed, either with the IME functionality or by re-writing, or by temporarily switching oft system 1 00, the output of sys- 
tem 100. generating a word that system 10 otherwise changed. Optionally, this step of applying the change to the set 
of rules is semi-automatic, not user initiated but using user confirmation. This embodiment also learns new POSTA- 
POSTROPHE words or removes them from the list. Optionally, the set of rules includes 6ome flags that are considered 
or not based on user interface settings, which determine whether certain ambiguous entries require an explicit choice 

55 by the user rather than system 1 00 proposing a certain initial output without further action. 

[0143J A further operating mode of system 100 when applied to file or clipboard data, system 100 automatically 
detects certain character set errors which result in wrong characters appearing in place of accented letters, To accom- 
plish this, system 100 uses a series of lists each associated to a common, known, transmission or character set prob- 
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lem, for example a 7-bit national character set used Instead of an B-blt one, the eights bit being stripped, a character 
set of one system used In the context of a different system, etc. Entries In these lists are used as activator events equiv- 
alent to, for example, accented vowels that are normally used where the correct character set is used. The replacement 
list Is selected either manually, or automatically, applying all fists to the same text, and then the one list that resulted in 
5 the text containing fewer unknown words is selected based on either a spelling checker dictionary or on the accent rule 
entries. 

[0144] In one embodiment of system 1 00 applied during typing, a small symbol on the screen changes color as a 
function of the reliability of the rule that was applied, for example ranking word entries higher than suffix entries, and 
entries with only one apostrophe or accent flag as less ambiguous than entries with multiple such flags, and the com- 

w pleteness of the current text context data where only one character of available text context data for example causes 
the color to appear as a yellow or orange warning. One variation of the rules system Is that entries for accented and 
unaccented verbal forms need not include aQ possible variations as a static database, but rather consider that Italian 
uses about 1 1 0 clearly-defined verb categories, each with Its known derived forms, to algorithmteaRy generate only the 
required verb forms when necessary. 

15 • 

List of Replacement Rules 

[0145] If the word to be replaced has an accent or apostrophe, then It Is not placed In the list of replacement rules, 
but Instead the appropriate COMPLEX attribute in one of the previous lists is used, I.e., five vowel lists, or consonant 
. 20 list If system 100 is applied to ancient ftaBan, or to some current Italian dialects such as in the Rome or Florence 
regions where words are often transformed to a truncated form using an apostrophe, then In an alternative embodiment 
the fallback rules are set for the vowel-lists to APOSTROPHE entries rather than GRAVE or ACUTE. Thus, the list of 
accented words are complete and exhaustive because all words with a sign thai do not match any rule would be output 
as words with an apostrophe rather than words with an accent. In ancient Italian, and In some of today's regional dia- 

25 lects, It is easier to define accented words rather than words with an apostrophe. In modem Italian, words with an apos- 
trophe are more limited so in one embodiment these are considered as exceptions from accent rules. In modem Italian 
accented words are also easily defined although their number Is higher than that of words ending with an apostrophe. 
A system giving a higher priority on a complete list of accented words may reach a point where, even for modem Italian, 
it may be of advantage to use the APOSTROPHE flag for fallback entries. In one particu lar embodiment of the Invention, 

30 system 1 00 utilizes resource-efficient rules lists, and is optionally more conservative in reaching conclusions. Thus, sys- 
tem 100 accommodates words that do not match any rule other than a talback rule, In which case an accent a more 
frequently occurring accent is placed on the word. 

[0146] It Is conceivable that, where system 1 00 is adapted for an ancient ItaHan or regional dialects application, or 
in a context where a second language that makes intense use of apostrophe characters is frequently used together with 

as Italian, system 100 optionally incorporates a feature similar to the re-correction or further modification applied after the 
detection ol POSTAPOSTROPHE strings, but generalized to all apostrophe characters which are initially converted to 
accents then followed by more text rather than non-word characters. Such an optional variation of system 1 0O is utilized 
if the additional feature to automatically Insert space characters after words ending with an apostrophe or accent is not 
active. The list with the replacement rules is separate from the lists for words ending with a vowel and that for words 

40 ending with a consonant for reasons of logical and computational simplicity. In a case where a word is not terminated 
with any activator events, and no other special options are enabled to correct, for example weekdays or words that 
should have a final accent or apostrophe but have been written without one, then system 100 checks the list of replace- 
ment rules If these are enabled rather than also the lists with all the entries. which are necessary tor the proper place- 
ment of accents and apostrophe signs. Trigrams, combinations of three letters, are optionally used instead of Digrams 

45 to further Improve the recognition accuracy at the expense of some additional memory requirements. 

Example Implementation 

[0147] The following is a description of a sample Implementation of a text processing system in accordance with the 
so present invention. The implementation is described using a pseudocode type description. Junction points are marked 
using angle brackets to indicate branch points in the logic flow. Comments begin with double backslash characters (//), 
and the event loop starts from (Procedure MainlnputLoop]. 

[Procedure CheckVowel WordS igns) 

55 

[0148] 

// This procedure gets an input word CurrentWord, ending with a vowel with or without diacritical sign or apostro- 
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phe, and returns accent/apostrophe information about the word. By definition, a word is a string of one or more 
alphabetic letters with or without diacritical signs, in upper or lower case, allowing for hyphen signs inside the word, 
as long as each hyphen is both preceded and followed by at least one alphabetic letter, and allowing for one 
optional apostrophe at the end of the word. 

[normalize CurrentWorti, converts all tetters to lower case tetters without diacritical signs, and removing final apos- 
trophe, if present] 

//The above step is optional, if we can say that the comparison functions ignore differences in case and diacritical 
marks. 

[if CurrentWord ends with letter A, set CurrentLlst to Ust-A] 
[If CurrentWord ends with letter E, set CurrentUst to Ust-EJ 
[If CurrentWord ends with letter I, set CurrentUst to Ust-I] 
[If CurrentWord ends with letter O, set CurrentUst to Ust-O] 
[If CurrentWord ends with letter U, set CurrentUst to list-U] 
[UstPosition = beginning of CurrentUst) 

(Junction 1) 

[0149] 

[(Rule at LlstPosition In CurrentUst Is a suffix rule and CurrentWord ends with that suffix) OR (Rule at UstPosltion 
in CurrentUst is instead a word rule and it matches CurrentWord)?] if No increase ListPosition and goto Junction 1 . 
// Now we have a positive match. In the worst case its the FALLBACK rule, which is at the end of the first part of 
the list. 

[Set ReturhRule to Rule at ListPosition in CurrentList] 

[If RetumRule is a suffix rule, then set RetumAttribute to NOT EXHAUSTIVE, else set RetumAttribute to EXHAUS- 
TIVE] 

[If RetumRule has APOSTROPHERARE flag and current program settings indicate to ignore such case, remove 
APOSTROPHE flag from RetumRule] 

[If Rule does not have FALLBACK flag, set ListPosition to position in CurrentLlst where the rule with FALLBACK flag 
is located] 

[Set ListPosition to next position] 

// now we are at the first rule after FALLBACK, which is either the first entry in the second part of the list, or we are 
beyond at the end of the flst 

(Junction 2) 

[0150] 

[If ListPosition is beyond end of list] Return 'RetumRule, ReturnAttribute" 

[(Rule at UstPosition in CurrentList is a suffix rule and CurrentWord ends with that suffix) OR (Rule at ListPosition 
In CurrentUst is instead a word rule and it matches CurrentWord)?] If No Increase UstPosition and goto Junction 2. 
// Now we have a positive match in the second part of the list 
[Set RetumRule to Rule at ListPosition in CurrentList] 

[If RetumRule has APOSTROPHERARE flag and current program settings Indicate to Ignore such case, remove 
APOSTROPHE flag from RetumRule] 
[Set RetumAttribute to EXHAUSTIVE] 
Return "RetumRule, RetumAttribute" 

[Procedure CheckConsonantWordSlgns] 

[0151] 

// This procedure gets an input word CurrentWord, ending with a consonant with or without apostrophe after it, and 
returns accent/apostrophe information about the word. 

[normafize CurrentWord, converting all letters to lower case letters without diacritical signs, and removing final 
apostrophe, If present] 

//The above step is optional rf the comparison functions ignore differences in case and diacritical marks 
[Set CurrentList to List-Consonants] 
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[ListPosition = beginning of CurrentUst] 
(Junction 1} 

5 [0152] 

[If UstPositton Is beyond end of list) Return "No entry found" 

[(Rule at ListPosition in CurrentUst is a suffix rule and CurrentWord ends with that suffix) OR (Rule at LtstPosition 
in CurrentUst is instead a word rule and it matches CurrentWord)?] If No Increase UstPosrtion and goto Junction 1 , 
%o [Set ReturnRule to Rule at ListPosition In CurrentUst] 

' [If ReturnRule has APOSTROPHERARE flag and current program settings Indicate to Ignore such case, remove 
APOSTROPHE flag from ReturnRule] 

[If ReturnRule is a suffix rule, then sat ReturnAttrfoute to NOT EXHAUSTIVE, else set RetumAttribute to EXHAUS- 
TIVE! 

is Return "ReturnRule, RetumAttribute" 
[Procedure CheckPostApostrophe] 
[0153] 

20 

[normalize CurrentWord, converting all letters to lower case letters without diacritical signs, and removing final 
apostrophe, If present] 

// The above step Is optional if the comparison functions ignore differences in case and diacritical marks 
[Set CurrentUst to List-PostApostrophe] 
25 [ListPosition = beginning of CurrentUst] 

(Junction 1) 

[0154] 

30 

[If ListPosition Is beyond end of list] Return TJO" 

[Rule at ListPosition in CurrentUst matches CurrentWord?] If No increase UstPosrtion and goto Junction 1. 
Return "YES" 

35 [Procedure CheckReplacement] 

[0155] 

[normalize CurrentWord, converting all letters to lower case letters without diacritical signs, and removing final 
40 apostrophe, if present] 

//The above step is optional, If the comparison functions ignore differences in case and diacritical marks 
[Set CurrentUst to List-Replacements] 
[UstPosition = beginning of CurrentUst] 

45 (Junction t ) 

[0156] 

[If ListPosition is beyond end of list] Return M No entry found" 
so (Rule at ListPosition in CurrentUst matches CurrentWord?] li No increase ListPosition and goto Junction 1 . 
[Set ReturnRule to Rule at ListPosition in CurrentUst] 
Return "ReturnRule* 

// by definition must be of type COMPLEX 
55 [Procedure Isltallan] 
[0157] 
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[tf the current application supports querying about language In use at current text Input position, query application 
and return Yes If language Is Italian, and No If not] 
//Different approaches may be undertaken 

[is there a rules fists with exhaustive entries tor all Italian words?) If Yes, check if word appears In vowel/consonants 
5 rules lists (return attribute must be EXHAUSTIVE) and te not flagged as NOHTALIAN, and return Yes If If the word 

is found and is ItaOan, and No If not 

[No rules-lists with exhaustive word entries? Then apply other algorithm, for example looking up all letter pairs in 
current word in a bigram table having t entries for letter pairs that exist In Italian words, an 0 for letter pairs that are 
not used in Italian, and return No if any pair of two consecutive letters in the word produces a 0, or otherwise return 
w Yes] 

Sample bigram table for Italian (real data, but variations are possible to allow for different levels of tolerance, e.g. 
with more or less consideration towards rare words and patterns, etc.): 

ABCDEFGH IJKLM NOPQ RSTU VWXYZ 

01 11 111 01 001 1 1 U01 1 1 1 10001//Row lor pairs "aa" to "az" 
11011 0001 001 001 001 001 00000//Row for pairs T>a p to *bz" 
1 01 01001 100101 1 01 1001 00000//etc. 
1 001 1 0001 000001 001 001 00000 
11111110100111111111110101 

10001100100100100100100000 

1 0001 0 1 1 1 001 1 1 1 001 001 00000 

1 0001 000 1 00000 1 00000000000 

11111110100111111111110001 
00000000000000000000000000 

00000000000000000000000000 
11111110100111111011110001 
1 10010001000101 10000100000 
10111110100001101011110001 

11111110100111110111110001 
100010001001001 1 01 1 1 100001 

000000000000000000001 00000 
11111110100111111111110001 
11101110100110111111110000 

1 0001 0001 000101 00101 1 00000 

11111110100111110111000001 
1 0001 0001 000001 001 001 1 0000 
00000000000000000000000000 
00000000000000000000000000 
00000000000000000000000000 

1 000 1 000 1 00000 1 000001 0000 1 




[Procedure GetNewContext] 
45 [0158] 

//Get (at least) the current word, until the cursor position. If here, then there was no opportunity to create a context 
buffer yet, or it was lost after vertical cursor movement, mouse action or keyboard, menu or other command that 
might have affected the text When requesting or getting context data, system 1 00 attempts to also get insert/over- 
50 strike, language and pending closing single quote information. If no such data is available, default values are used. 
If however context data was previously available for that input window, then the InsenVOverstrlke setting is pre- 
served, and not reset to a default value. 

[If operating system 1 26 and current application 1 30 support querying of context data as part of an appKcation-spe- 
crfic interface, or for purposes of accessibility for disabled users, or as part of an I ME Interface, or as part of an error 
55 handling interface, or as part of any other interface capable of providing thai information, the context is obtained 
from there, and return] 

[If the hardware, operating system 1 26 or current application 130 (e.g. a word processor) provides a way of directly 
accessing the text buffer memory (RAM), e.g. because the memory region is constant, or pointers to that region are 



37 



EP 1 093 058 A1 



known, the context Is obtained from there, and return] 

[Locate cursor position and appty OCR to get current word context, tor example using library provided by a remote 
system 266 via network 264. If the screen Is not bitmapped, but character-mode, it Is only necessary to Isolate text 
from non-relevant characters. Return If successful.] 
5 Clear local context data and return 
// Fail, there Is no context data 

[Procedure MainlnputLoop] 

w [0159] 

// Main inpul loop. Shields the text-processing part from a few non-text-stream issues. 
(Junction 1 ) 

75 

[0160] 

[Walt f o r keyboard or mouse event] 

[Non-character event potentially involving context disruption?] If Yes, GetNewContext and goto junction 1 
20 // Events that Involve context disruption Include: new window; cursor up/down and other cursor positioning keys 

(e.g. Home, End. Page Up, Page Down) other than cursor left/right; mouse dick events that cause cursor to be 

repositioned; menu selections and keyboard accelerators to menu selections; command-shortcuts, 

[Cursor left or right, or Delete, or Backspace key?] If Yes, update local context buffer contents and Insertion position 

accordingly, then goto Junction 1 
25 [Insert key?] If Yes, update Insert/overstrike mode status in context data, than goto Junction 1 . 

[Does current application support notification of language and Insert/overstrike status?) If Yes, read these settings 

again and update them In the local context data. 

[Text character?] If Yes, update local context buffer, then call TextlnputLoop. If TextlnputLoop applied changes to 
the output stream, update context buffer again and send backspace or cursor-left and new characters as appropri- 
ate ate. 

//Text characters include letters, numbers, space, punctuation, and all other graphical characters that produce an 
editing action. 
Goto Junction 1 

as [Procedure TextlnputLoop] 

[0161] 

// Text input loop, gets called whenever a new character appears In the input stream. 
40 [Is the character an activator event?] If Yes execute ActivatorCharacter, then Return. 

// depending on program options, activator events can be the apostrophe and similar characters, or an accented 
letter 

(Non-word character?) If Yes execute NonWordCharacter. 
Return 

45 

[Procedure ActivatorCharacter] 
[0162] 

so // If we are here, in an Italian implementation it means that the user pressed an accented vowel key, or an apostro- 
phe after a word 

[Same position as a previous activator event that caused system action, which was manually changed by user?] If 
yes, Return. 

// Do nothing If something just happened, and the user changed what was done. If however nothing is done, and 
55 the user again changes the input, then again something is done, because this time the previous time was not such 
that system action was Initiated. The result is that something Is done every second time. 
[Same activator event as previous character?) If Yes, execute next step in ImeLoop, then Return. 
[Acute character, or other character equivalent lo apostrophe?) If Yes. replace it with apostrophe 
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// note: change In local context data only; later all differences will be cumulatively applied to output stream. This 
transformation from acute etc. to apostrophe is an example of many optional things that can be done. 
[Activator event Is accented vowel?] If yes, add It to the current word 

// Here system 1 00 is adding to the local context data. The application already received the character, and what can 
5 be done (later, If neccessary) Is to send a fake backspace (and/or cursor left, tf oversuike mode) followed by new 
data (unless backspace alone was sufficient). 

[Last character of the current word te a vowel?) If Yes Check VowelWordSIgns else CheckConsonantWordSigns 
[No RetumRule was found?] If so, Return 

//This can happen if the word ended with a consonant, and input was OK (word not in list), because vowel lists pro- 
w vide fallback rules 

[RetumRule has COMPLEX attribute?] If Yes, replace word with COMPLEX word (If the word was different), and 
Return. 

//This is an example of action that can be turned on or off by the user, or depending on the implementation 
// Only three cases possible: vowel with accent, vowel with apostrophe, consonant with apostrophe 
is [Activator event Is on or after vowel?] If Yes 
< 

(Activator event is accent?] If yes, ProcessVowelAccent, else ProcessVowelApostrophe 
} 

Else ProcessConsonantApostrophe 
20 Return 

[Procedure NonWdrdCharacter] 

[01631 

25 . 

//checks replacement rules, and POSTAPOSTROPHE 

[Did system 100 change user input of apostrophe immediately before this word?) If yes 
{ 

30 

[CheckPostApostrophe gives POSTAPOSTROPHE match on current word?) 
If yes, restore previously changed apostrophe, and Return 

35 

Check Replacement 

[RetumRule has COMPLEX attribute?] If Yes, replace word with COMPLEX word (if the word was different) 
Return 

40 [Procedure ProcessVowelApostrophe] 
[0164] 

// Handling of Word ending with vowel and followed by apostrophe activator event. Word in this entire subroutine 
45 means word with apostrophe 

//This Is one of the most complex cases, because the intention may have been to enter a closing single quote (an 
opening single quote would not have immediately followed a word, but rather it would have preceded it) 
[RetumRule has APOSTROPHE attribute, and none of GRAVE or ACUTE or CIRCUMFLEX attributes?] If Yes 

50 { 

New Word = Word 

[RetumRule also has NOTHING flag?] If Yes, Optionally (based on implementation and/or settings): inform 
user via tool tip that the case is ambiguous, and could be resolved in more than one way, adding additional 
RetumRule information as appropriate 
55 Return 
J 

// the above is the simplest case; no ambiguity, nothing to correct; we could however issue an optional information 
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message if the rule also had the NOTHING flag. Most practical ambiguities are however taken care of via APOS- 
TROPHE RARE, which te already filtered based on Implementation/settings. 
[ReturnRule has APOSTROPHE attribute, and expecting a closing single quote?] tf Yes 

5 { 

NewWord = Word 

Optionally (based on implementation and/or settings): inform user via tool tip that the case is ambiguous, and 
could be resolved in more than one way, adding additional ReturnRule information as appropriate 
Return 
to } 

// the above represents a statistical fact that If the word can be written with an apostrophe, and a dosing quote is 
expected, then it is more likely that the user actually wanted to input an apostrophe, even if the word can also be 
written with an accent [ReturnRule has NOTHING attrbute, and none of APOSTROPHE, GRAVE or ACUTE or 
is CI RCUM FLEX attributes?] If Yes 

{ 

[expecting a closing single quote?] If Yes, NewWord = Word 
Else NewWord - Word without apostrophe 
20 Return 
} 

// tf system 100 Is here, there is APOSTROPHE as well as one or more other accent flags, in which case, based 
on a statistical choice, priority is given to the accent, tf only one (which is usually the case), or there are one or more 
25 accent flags, In which case system 1 00 changes the apostrophe Input to an accent output This all means that the 
APOSTROPHE flag can be ignored from here on, as it does not change anything, because the cases in which an 
apostrophe is output have all already been considered (ReturnRule has more than one of NOTHING or GRAVE or 
ACUTE or CI RCUMFLEX attributes?] If Yes 

.30 { 

NewWord = Word with first most likely accent (first item of sequence used for IME loop for last vowel In word, 
considering only the accent flags in ReturnRule) 

Optionally (based on implementation and/or settings): inform user via tool tip that the case Is ambiguous, and 
could be resolved in more than one way, adding additional ReturnRule information as appropriate 
as . Return 

} 

// Note: the above is rare 

// If system 1 00 is here, it means that the word has one and only one of GRAVE or ACUTE or CIRCUMFLEX, plus, 

40 possibly, APOSTROPH E 

NewWord = Word with accent as per single accent flag (GRAVE or ACUTE or CIRCUMFLEX) 
[ReturnRule also has APOSTROPHE flag?] Optionally (based on implementation and/or settings): inform user via 
tool tip that the case is ambiguous, and could be resolved in more than one way, adding additional ReturnRule infor- 
mation as appropriate 

45 Return 

[Procedure Process Vowel Accent] 
[0165] 

50 

// Handling of Word ending with vowel Input as accented vowel activator event 

// This case is simpler than vowel + apostrophe, because although the accent could be wrong, having to be 
changed to nothing, or to an apostrophe, the case where a closing quote could have been intended does not apply 
here 

55 [ReturnRule has only one of APOSTROPHE, GRAVE, ACUTE or CIRCUMFLEX?] 
i 

NewWord = Word with sign as specified by APOSTROPHE, GRAVE, ACUTE or CIRCUMFLEX 
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[ReturnRule also has NOTHING flag?] If Yes, Optionally (based on Implementation and/or settings): Inform 

user via tool tip that the case is ambiguous, and could be resolved In more than one way, adding additional 

ReturnRule information as appropriate 

Return 

} 

// If here, the ReturnRule has NOTHING and/or more than one accent/apostrophe flag 
f ReturnRule has more than one of APOSTROPHE, GRAVE, ACUTE or CIRCUMFLEX?] 

{ 

NewWord = Word, If compatible with ReturnRule flags, or otherwise Word with first most likely accent (first Item 
of sequence used for IME loop for last vowel in word, considering only the accent flags we have in ReturnRule) 
Optionally (based on implementation and/or settings): inform user vie tool tip that the case Is ambiguous, and 
could be resolved in more than one way, adding additional ReturnRule information as appropriate 
Return 

} 

U If here, the ReturnRule has NOTHING flag and no accent or apostrophe flag 

New Word = Word without accent 

Return 

[Procedure ProcessConsonantApostrophe] 
[0166] 

// Handling of Word ending with consonant and apostrophe activator event 

// Here a dosing quote could be expected, but the number of possibilities for the word itself are only two: apostro- 
phe or no apostrophe (consonants do not have accents) 
[ReturnRule has APOSTROPHE attribute?] If Yes 

{ 

NewWord = Word 

Return 

} 

// If here, the ReturnRule has a NOTHING flag and no APOSTROPHE 

[Expecting a closing single quote?] If Yes 

{ 

NewWord = Word 

Return 
} 

// Note: in cases like the above, if In a very demanding editorial context, system 100 ensures that the apostrophe 
found here after a word with NOTHING and no APOSTROPHE flag actually was the closing quote being looking 
for, rather than a mistake. In such a demanding context, appropriate Information messages are optionally used. 
NewWord = Word without apostrophe, followed by space 
Return 

// Note: in case this space is followed by a punctuation sign, system 100 optionally re-corrects of further modifies 
the automatically inserted space, removing it Optionally, system 100 does not even add a space character in the 
first place. 

[0167] It is believed that the method and apparatus for processing text and character data of the present invention 
and many of its attendant advantages will be understood by the foregoing description, and it will be apparent that vari- 
ous changes may be made in the form, construction and arrangement of the components thereof without departing 
from the scope and spirit of the invention or without sacrificing all of Its material advantages. The form herein before 
described being merely an explanatory embodiment thereof. It is the intention of the following claims to encompass and 
include such changes. The invention described herein need not implement or require any one particular or all of the 
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embodiments or parts thereof; Indeed a system, hardware, or software, may optionally implement any one or more of 
the embotfments described herein, in whole or In part, at en times or less than at ail times, and without requiring any 
one or more remaining embodiments thereof, In whole or In part, without departing from the spirit or scope of the Inven- 
tion and without providing substantial change thereto. For example, a system may be optimized for Italian text process- 

5 ing with or without using German text processing, or alternatively a system may be optimized for German text 
processing with or without Italian text processing. Furthermore, a system Implementing text processing in accordance 
with the present invention may be optimized for processing one level or formality of text, for example tor newspaper or 
newsprint text, or alternatively may be optimized lor another level or formality of text, such as scientific literature, or 
alternatively may be optimized for another level of formality of text, such as popular fiction, without Implementing or 

10 being optimized for other levels or formalities of text as determined by requirements and the desired level or formality 
of processing, and without departing from the scope or spirit of the Invention and without providing substantial change 
thereto. 

Claims 

1. An apparatus, comprising: 

means for receiving Input text 

means for detecting an activator event In the input text; end 
20 means for modifying a word in the Input text in response to said detecting means detecting an activator event. 

2. An apparatus as claimed in claim 1 p wherein the activator event includes actuation of a predetermined key of a key- 
board and/or follows actuation of another predetermined key of said keyboard. 

25 3. An apparatus as claimed in claim 2, the predetermined key of a keyboard being at least one of an apostrophe key, 
a vowel key, a currency key, an accented letter key, and a punctuation key. 

4. An apparatus as claimed In ciaim 1, further comprising means for detecting a subsequent BCtivator event in the 
input text in succession from a first detected activator event. 

30 

5. An apparatus as claimed In claim 1 , wherein characters not Included in a character set of the input text are encoded 
using the character set for the text input 

6. An apparatus as claimed in claim 1 , wherein said detecting means detects an activator event based upon a context 
35 of the input text. 

7. An apparatus as claimed in claim 1, wherein said modifying means selects a modification of the word based upon 
a frequency of occurrence of available word modifications. 

AO 8, An apparatus as claimed in claim 1 , wherein said modifying means selects a modification of the word based upon 
grammar rules of a language of the Input text 

9. An apparatus as claimed in claim 1 , said modifying means selecting a modification based upon a previous word 
modification selected by a user. 

45 

10. An apparatus as claimed In claim 1. said modifying means providing optimal accenting and punctuation of a word 
in the text input 

11. A computer readable medium tangibry embodying computer readable code stored thereon for implementing a 
so method for processing text, the method comprising: 

receiving input text; 

detecting an activator event In the input text; and 

modifying a word in the input text in response to said detecting means detecting an activator event. 

55 

12. An apparatus, comprising: 

means for receiving input text: 
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means for detecting an apostrophe In the Input text; 

means for Initiating an Input method editor loop in response to said detecting means detecting an apostrophe 
in the input text; 

and means for modifying a word in the input text based upon a word modification contained In the input editor 

5 lOOp. 

13. An apparatus as claimed in claim 12, the input method editor loop containing e hierarchy of word modifications in 
a predetermined hierarchy. 

10 14. An apparatus as claimed in claim 13, said modifying means providing successive modifications of the word upon 
successive apostrophes detected by said detecting means. 

15. An apparatus as claimed in claim 14 r wherein the successive modifications provided by said modifying means are 
Implemented according to a hierarchy of word modifications in the input method editor loop. 

15 

16. An apparatus as claimed in claim 12, wherein the Input method editor loop Includes a hierarchy of word modifica- 
tions in an order determined by Italian language rules and/or frequency of word modifications in the loop. 

17. An apparatus as claimed in claim 12, said modifying means modifying the word to provide en optimally accented 
20 form of the word without requiring a user to select an accented form of the word. 
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